Jul 20 16:34:41 devstack cinder-volume[76333]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 20 16:34:41 devstack cinder-volume[76333]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 20 16:34:41 devstack cinder-volume[76333]: we strongly recommend against using it for new projects. Jul 20 16:34:41 devstack cinder-volume[76333]: If you are already using Eventlet, we recommend migrating to a different Jul 20 16:34:41 devstack cinder-volume[76333]: framework. For more detail see Jul 20 16:34:41 devstack cinder-volume[76333]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 20 16:34:41 devstack cinder-volume[76333]: import eventlet # noqa Jul 20 16:34:44 devstack cinder-volume[76333]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:34:44 devstack cinder-volume[76333]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:34:44 devstack cinder-volume[76333]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:34:45 devstack cinder-volume[76333]: INFO dbcounter [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Registered counter for database cinder Jul 20 16:34:45 devstack cinder-volume[76333]: DEBUG oslo_db.sqlalchemy.engines [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:34:45 devstack cinder-volume[76333]: DEBUG dbcounter [-] [76333] Writer thread running {{(pid=76333) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 20 16:34:45 devstack cinder-volume[76333]: INFO cinder.rpc [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 20 16:34:45 devstack cinder-volume[76333]: INFO cinder.rpc [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 20 16:34:45 devstack cinder-volume[76333]: DEBUG oslo_db.sqlalchemy.engines [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:34:46 devstack cinder-volume[76333]: INFO cinder.volume.manager [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Determined volume DB was empty at startup. Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG cinder.volume.manager [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76333) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 20 16:34:46 devstack cinder-volume[76333]: INFO cinder.volume.manager [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 20 16:34:46 devstack cinder-volume[76333]: WARNING stevedore.named [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 20 16:34:46 devstack cinder-volume[76333]: WARNING castellan.key_manager [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:34:46 devstack cinder-volume[76333]: WARNING cinder.keymgr.conf_key_mgr [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG cinder.volume.drivers.lvm [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76333) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_concurrency.processutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76333) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_concurrency.processutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] CMD "cinder-rtstool verify" returned: 0 in 0.524s {{(pid=76333) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_db.sqlalchemy.engines [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:34:46 devstack cinder-volume[76333]: INFO cinder.rpc [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 20 16:34:46 devstack cinder-volume[76333]: INFO cinder.rpc [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 20 16:34:46 devstack cinder-volume[76333]: WARNING stevedore.named [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 20 16:34:46 devstack cinder-volume[76333]: WARNING castellan.key_manager [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:34:46 devstack cinder-volume[76333]: INFO cinder.volume.manager [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_db.sqlalchemy.engines [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:34:46 devstack cinder-volume[76333]: INFO oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Starting 1 workers Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Started child 76487 {{(pid=76333) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Full set of CONF: {{(pid=76333) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] ******************************************************************************** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Configuration options gathered from: {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] ================================================================================ {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] allow_availability_zone_fallback = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] allow_compression_on_image_upload = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] allowed_direct_url_schemes = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] api_rate_limit = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] auth_strategy = keystone {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76487]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] az_cache_duration = 3600 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_availability_zone = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_host = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_stats_polling_interval = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backup_api_class = cinder.backup.api.API {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backup_name_template = backup-%s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backup_use_same_host = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backup_use_temp_snapshot = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] chap_password = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] chap_username = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_internal_tenant_project_id = 665b025f6e3d45a1bb55eae29f95f9b9 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_internal_tenant_user_id = b6c87ac2475a43919730766fa19ac79d {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cloned_volume_same_az = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cluster = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] compression_format = gzip {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] compute_api_class = cinder.compute.nova.API {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] config_dir = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] config_source = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] control_exchange = openstack {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] debug = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] default_availability_zone = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] default_group_type = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] default_volume_type = lvmdriver-1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] disk_geometry = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] driver_client_cert = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] driver_client_cert_key = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] driver_data_namespace = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] driver_ssl_cert_path = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] driver_ssl_cert_verify = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] driver_use_ssl = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] enable_force_upload = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] enable_new_services = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] enable_unsupported_driver = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] enforce_multipath_for_image_xfer = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] filter_function = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_api_insecure = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_api_ssl_compression = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_ca_certificates_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_catalog_info = image:glance:publicURL {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_num_retries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance_request_timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] goodness_function = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] graceful_shutdown_timeout = 5 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] group_api_class = cinder.group.api.API {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] host = devstack {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_compress_on_upload = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_conversion_address_space_limit = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_conversion_cpu_limit = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_conversion_disable = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_upload_use_cinder_backend = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_upload_use_internal_tenant = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_volume_cache_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_volume_cache_max_count = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] image_volume_cache_max_size_gb = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] init_host_max_objects_retrieval = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] instance_format = [instance: %(uuid)s] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] iscsi_target_flags = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] iscsi_write_cache = on {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] iser_helper = tgtadm {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] iser_ip_address = 192.168.122.72 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] iser_port = 3260 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_color = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_config_append = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_dir = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_options = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_rotate_interval = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_rotate_interval_type = days {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] log_rotation_type = none {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] max_age = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] max_logfile_count = 30 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] max_logfile_size_mb = 200 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] max_over_subscription_ratio = 20.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] message_reap_interval = 86400 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] message_ttl = 2592000 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] migration_create_volume_timeout_secs = 300 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] monkey_patch = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] monkey_patch_modules = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] my_ip = 192.168.122.72 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] no_snapshot_gb_quota = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] num_iser_scan_tries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] num_shell_tries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] num_volume_device_scan_tries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] nvmeof_conn_info_version = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] nvmet_ns_id = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] nvmet_port_id = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_max_limit = 1000 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_volume_ext_list = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_volume_listen_port = 8776 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_volume_use_ssl = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] osapi_volume_workers = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] per_volume_size_limit = -1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] periodic_fuzzy_delay = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] periodic_interval = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] public_endpoint = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] publish_errors = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_backup_gigabytes = 1000 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_backups = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_gigabytes = 1000 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_groups = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_snapshots = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] quota_volumes = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] rate_limit_burst = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] rate_limit_except_level = CRITICAL {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] rate_limit_interval = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] reinit_driver_count = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] replication_device = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] report_discard_supported = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] report_interval = 120 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] reservation_clean_interval = 86400 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] reservation_expire = 86400 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] reserved_image_namespaces = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] reserved_percentage = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] rpc_response_timeout = 120 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] run_external_periodic_tasks = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] scst_target_driver = iscsi {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] scst_target_iqn_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_down_time = 720 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] shell_completion = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] snapshot_name_template = snapshot-%s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] snapshot_same_host = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] split_loggers = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] state_path = /opt/stack/data/cinder {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] storage_availability_zone = nova {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] storage_protocol = iSCSI {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] syslog_log_facility = LOG_USER {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] target_helper = lioadm {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] target_ip_address = 192.168.122.72 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] target_port = 3260 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] target_protocol = iscsi {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] target_secondary_ip_addresses = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] trace_flags = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] transport_url = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] until_refresh = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_chap_auth = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_default_quota_class = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_journal = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_json = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_multipath_for_image_xfer = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_stderr = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] use_syslog = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] verify_glance_signatures = enabled {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_api_class = cinder.volume.api.API {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_backend_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_clear = zero {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_clear_ionice = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_clear_size = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_copy_bps_limit = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_dd_blocksize = 1M {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_name_template = volume-%s {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_service_inithost_offload = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volume_usage_audit_period = month {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] zoning_mode = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_concurrency.disable_process_locking = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.auth_section = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.auth_type = password {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.auth_version = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.cache = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.include_service_catalog = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.insecure = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.interface = public {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_password = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcache_username = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.region_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.service_type = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.backend = dogpile.cache.null {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.backend_argument = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.backend_expiration_time = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.config_prefix = cache.oslo {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.debug_cache_backend = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.enable_retry_client = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.enable_socket_keepalive = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.expiration_time = 600 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.hashclient_retry_attempts = 2 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_dead_retry = 300 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_pool_maxsize = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_sasl_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.password = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.proxies = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.redis_db = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.redis_server = localhost:6379 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.retry_attempts = 2 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.retry_delay = 0.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.socket_keepalive_count = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.socket_keepalive_idle = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.socket_keepalive_interval = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.socket_timeout = 1.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.tls_allowed_ciphers = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.tls_cafile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.tls_certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.tls_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.tls_keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cache.username = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] coordination.backend_url = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.asyncio_connection = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.asyncio_slave_connection = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.backend = sqlalchemy {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.connection = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.connection_debug = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.connection_parameters = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.connection_recycle_time = 3600 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.connection_trace = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.db_inc_retry_interval = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.db_max_retries = 20 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.db_max_retry_interval = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.db_retry_interval = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.max_overflow = 50 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.max_pool_size = 5 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.max_retries = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.mysql_wsrep_sync_wait = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.pool_timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.retry_interval = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.slave_connection = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.sqlite_synchronous = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.synchronous_reader = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] database.use_db_reconnect = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.connection_string = messaging:// {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.es_doc_type = notification {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.es_scroll_size = 10000 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.es_scroll_time = 2m {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.filter_error_trace = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.hmac_keys = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.sentinel_service_name = mymaster {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.socket_timeout = 0.1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.trace_requests = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler.trace_sqlalchemy = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler_jaeger.process_tags = {} {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler_jaeger.service_name_prefix = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] profiler_otlp.service_name_prefix = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.enforce_new_defaults = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.policy_default_rule = default {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.policy_file = policy.yaml {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.group = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.helper_command = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] privsep_osbrick.user = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.group = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.helper_command = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] cinder_sys_admin.user = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.auth_section = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.auth_type = password {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.cafile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.collect_timing = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.insecure = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.send_service_user_token = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.split_loggers = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack sudo[76514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] service_user.timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.auth_section = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.auth_type = password {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.collect_timing = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.insecure = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.region_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack sudo[76514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.split_loggers = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] glance.timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.backend_availability_zone = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.chap_password = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.chap_username = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.disk_geometry = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.driver_client_cert = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.driver_client_cert_key = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.driver_data_namespace = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.driver_use_ssl = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.extra_capabilities = {} {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.filter_function = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.goodness_function = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.iscsi_target_flags = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.iscsi_write_cache = on {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.iser_helper = tgtadm {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.iser_port = 3260 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.lvm_share_target = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.lvm_type = auto {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.num_shell_tries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.replication_device = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.report_discard_supported = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.reserved_percentage = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.target_helper = tgtadm {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.target_port = 3260 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.target_protocol = iscsi {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.trace_flags = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.unique_fqdn_network = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.use_chap_auth = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_backend_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_clear = zero {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_clear_ionice = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_clear_size = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:46 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_reports.file_event_handler = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_reports.log_dir = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.backend_host = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.chap_password = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.chap_username = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.disk_geometry = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.driver_client_cert = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.extra_capabilities = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.filter_function = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.goodness_function = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.iser_helper = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.iser_ip_address = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.iser_port = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.lvm_share_target = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.lvm_type = auto {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.num_shell_tries = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.replication_device = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.report_discard_supported = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.reserved_percentage = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.scst_target_driver = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.storage_protocol = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.target_helper = lioadm {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.target_ip_address = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.target_port = 3260 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.trace_flags = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.use_chap_auth = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_clear = zero {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_clear_size = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] lvmdriver-1.volumes_dir = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_notifications.driver = [] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_notifications.retry = -1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] key_manager.fixed_key = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.barbican_api_version = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.barbican_endpoint = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.barbican_endpoint_type = public {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.barbican_region_name = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.cafile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.collect_timing = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.insecure = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.number_of_retries = 60 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.retry_delay = 1 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.send_service_user_token = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.split_loggers = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.verify_ssl = True {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican.verify_ssl_path = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.auth_section = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.auth_type = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.cafile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.certfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.collect_timing = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.insecure = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.keyfile = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.split_loggers = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] barbican_service_user.timeout = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.approle_role_id = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.approle_secret_id = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.auth_method = approle {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.auth_path = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.kv_mountpoint = secret {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.kv_path = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.kv_version = 2 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.namespace = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.root_token_id = **** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.ssl_ca_crt_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.timeout = 60.0 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.token_file = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.token_role = None {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.use_ssl = False {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:34:47 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] ******************************************************************************** {{(pid=76333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 20 16:34:47 devstack sudo[76514]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:47 devstack sudo[76629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:47 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:47 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:34:47 devstack cinder-volume[76487]: INFO cinder.brick.local_dev.lvm [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:47 devstack sudo[76715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:34:47 devstack sudo[76715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:47 devstack sudo[76715]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG cinder.brick.local_dev.lvm [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76487) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 20 16:34:47 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:47 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:47 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:48 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:48 devstack sudo[76990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:48 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:48 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:48 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 20 16:34:48 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:48 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.255s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:48 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:48 devstack sudo[77095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:34:48 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:49 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:49 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:49 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:49 devstack sudo[77179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:34:49 devstack sudo[77179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:49 devstack sudo[77179]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:49 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:49 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:49 devstack sudo[77185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:49 devstack sudo[77185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:49 devstack sudo[77185]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:49 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.360s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:49 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:49 devstack sudo[77266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:49 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:50 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:50 devstack sudo[77281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:50 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:50 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:50 devstack cinder-volume[76487]: INFO cinder.volume.drivers.lvm [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:50 devstack sudo[77285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:50 devstack sudo[77285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:50 devstack sudo[77285]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:50 devstack sudo[77288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:34:50 devstack sudo[77288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:50 devstack sudo[77288]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:50 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:50 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:50 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:51 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:51 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:51 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:51 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:51 devstack sudo[77297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:51 devstack sudo[77297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:51 devstack sudo[77297]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:51 devstack cinder-volume[76487]: INFO cinder.volume.driver [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Driver hasn't implemented _init_vendor_properties() Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG cinder.volume.driver [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76487) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_db.sqlalchemy.engines [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writer thread running {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG cinder.db.api [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Building query based on filter {{(pid=76487) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG cinder.image.image_utils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76487) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 20 16:34:51 devstack cinder-volume[76487]: INFO cinder.keymgr.migration [None req-2872a617-bfb4-454b-a141-a19b49444bdc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 20 16:34:51 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:51 devstack sudo[77301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:34:51 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:52 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:52 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:52 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:52 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:52 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:52 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:52 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:52 devstack sudo[77312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:52 devstack sudo[77312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:52 devstack sudo[77312]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:34:52 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Driver initialization completed successfully. Jul 20 16:34:52 devstack cinder-volume[76487]: INFO cinder.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Initiating service 2 cleanup Jul 20 16:34:52 devstack cinder-volume[76487]: INFO cinder.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Service 2 cleanup completed. Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG cinder.service [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Creating RPC server for service cinder-volume {{(pid=76487) start /opt/stack/cinder/cinder/service.py:231}} Jul 20 16:34:52 devstack cinder-volume[76487]: DEBUG cinder.service [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76487) start /opt/stack/cinder/cinder/service.py:237}} Jul 20 16:34:53 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:53 devstack sudo[77317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:34:53 devstack sudo[77317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:53 devstack sudo[77317]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:53 devstack sudo[77320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:53 devstack sudo[77320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:53 devstack sudo[77320]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:53 devstack sudo[77326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:34:53 devstack sudo[77326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:53 devstack sudo[77326]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:34:53 devstack sudo[77329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:34:53 devstack sudo[77329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:34:54 devstack sudo[77329]: pam_unix(sudo:session): session closed for user root Jul 20 16:34:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:34:54 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2287c1bf-ebf6-4331-b597-926fa0334d4d None None] Driver post RPC initialization completed successfully. Jul 20 16:34:56 devstack cinder-volume[76333]: DEBUG dbcounter [-] [76333] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76333) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:35:04 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:35:04 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:35:30 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running periodic task VolumeManager._thread_info {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:35:30 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] thread count: 6 {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:35:30 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] thread info: [<_MainThread(MainThread, started 137552348352640)>, , , , , ] {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:36:30 devstack sudo[82106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:36:30 devstack sudo[82106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:36:30 devstack sudo[82106]: pam_unix(sudo:session): session closed for user root Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:36:30 devstack sudo[82238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:36:30 devstack sudo[82238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:36:30 devstack sudo[82238]: pam_unix(sudo:session): session closed for user root Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:36:30 devstack sudo[82366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:36:30 devstack sudo[82366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:36:30 devstack sudo[82366]: pam_unix(sudo:session): session closed for user root Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:36:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:36:30 devstack sudo[82470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:36:30 devstack sudo[82470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:36:31 devstack sudo[82470]: pam_unix(sudo:session): session closed for user root Jul 20 16:36:31 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:36:31 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:36:31 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running periodic task VolumeManager._thread_info {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:36:31 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] thread count: 6 {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:36:31 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] thread info: [<_MainThread(MainThread, started 137552348352640)>, , , , , ] {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:37:04 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:37:04 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:37:30 devstack sudo[83919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:37:30 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:37:30 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:37:30 devstack sudo[83934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:37:30 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:37:30 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:37:30 devstack sudo[83943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:37:30 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:37:30 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:37:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:37:30 devstack sudo[83955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:37:30 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:37:31 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root Jul 20 16:37:31 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:37:31 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:38:30 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 20 16:38:30 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:38:30 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:38:30 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:38:30 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:38:30 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:38:30 devstack sudo[85432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 20 16:38:30 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:38:30 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:38:30 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:38:30 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 20 16:38:30 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:38:31 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Jul 20 16:38:31 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:38:31 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:38:31 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] Running periodic task VolumeManager._thread_info {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:38:31 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] thread count: 6 {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:38:31 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-9e65c9cb-b571-4b62-9480-438110d69bfa None None] thread info: [<_MainThread(MainThread, started 137552348352640)>, , , , , ] {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:39:04 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:39:20 devstack cinder-volume[76333]: INFO oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Caught SIGTERM, stopping children Jul 20 16:39:20 devstack cinder-volume[76333]: DEBUG oslo_concurrency.lockutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Acquiring lock "singleton_lock" {{(pid=76333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:39:20 devstack cinder-volume[76333]: DEBUG oslo_concurrency.lockutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Acquired lock "singleton_lock" {{(pid=76333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:39:20 devstack cinder-volume[76333]: DEBUG oslo_concurrency.lockutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Releasing lock "singleton_lock" {{(pid=76333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:39:20 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Stop services. {{(pid=76333) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 20 16:39:20 devstack cinder-volume[76333]: DEBUG oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Killing children. {{(pid=76333) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 20 16:39:20 devstack cinder-volume[76333]: INFO oslo_service.backend._eventlet.service [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Waiting on 1 children to exit Jul 20 16:39:25 devstack cinder-volume[76487]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 20 16:39:25 devstack cinder-volume[86547]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 20 16:39:25 devstack cinder-volume[86547]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 20 16:39:25 devstack cinder-volume[86547]: we strongly recommend against using it for new projects. Jul 20 16:39:25 devstack cinder-volume[86547]: If you are already using Eventlet, we recommend migrating to a different Jul 20 16:39:25 devstack cinder-volume[86547]: framework. For more detail see Jul 20 16:39:25 devstack cinder-volume[86547]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 20 16:39:25 devstack cinder-volume[86547]: import eventlet # noqa Jul 20 16:39:27 devstack cinder-volume[86547]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:39:27 devstack cinder-volume[86547]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:39:27 devstack cinder-volume[86547]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:39:27 devstack cinder-volume[76487]: DEBUG oslo_concurrency.lockutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Acquiring lock "singleton_lock" {{(pid=76487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:39:27 devstack cinder-volume[76487]: DEBUG oslo_concurrency.lockutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Acquired lock "singleton_lock" {{(pid=76487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:39:27 devstack cinder-volume[76487]: DEBUG oslo_concurrency.lockutils [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Releasing lock "singleton_lock" {{(pid=76487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:39:27 devstack cinder-volume[76487]: WARNING amqp [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 20 16:39:28 devstack cinder-volume[76487]: WARNING amqp [None req-476c7874-8d46-4d67-8507-3c79ea86a24b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 20 16:39:28 devstack cinder-volume[86547]: INFO dbcounter [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Registered counter for database cinder Jul 20 16:39:28 devstack cinder-volume[86547]: DEBUG oslo_db.sqlalchemy.engines [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG dbcounter [-] [86547] Writer thread running {{(pid=86547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 20 16:39:29 devstack cinder-volume[86547]: INFO cinder.rpc [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 20 16:39:29 devstack cinder-volume[86547]: INFO cinder.rpc [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_db.sqlalchemy.engines [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:29 devstack cinder-volume[86547]: INFO cinder.volume.manager [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Determined volume DB was empty at startup. Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG cinder.volume.manager [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86547) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 20 16:39:29 devstack cinder-volume[86547]: INFO cinder.volume.manager [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 20 16:39:29 devstack cinder-volume[86547]: WARNING stevedore.named [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 20 16:39:29 devstack cinder-volume[86547]: WARNING castellan.key_manager [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:39:29 devstack cinder-volume[86547]: WARNING cinder.keymgr.conf_key_mgr [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:39:29 devstack cinder-volume[86547]: INFO cinder.volume.manager [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_db.sqlalchemy.engines [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:29 devstack cinder-volume[86547]: INFO oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Starting 1 workers Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Started child 86765 {{(pid=86547) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Full set of CONF: {{(pid=86547) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] ******************************************************************************** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Configuration options gathered from: {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] ================================================================================ {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] allow_availability_zone_fallback = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] allow_compression_on_image_upload = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] allowed_direct_url_schemes = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] api_rate_limit = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86765]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] auth_strategy = keystone {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_availability_zone = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_host = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_stats_polling_interval = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backup_api_class = cinder.backup.api.API {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backup_name_template = backup-%s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backup_use_same_host = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backup_use_temp_snapshot = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] chap_password = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] chap_username = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_internal_tenant_project_id = 665b025f6e3d45a1bb55eae29f95f9b9 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_internal_tenant_user_id = b6c87ac2475a43919730766fa19ac79d {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cluster = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] compression_format = gzip {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] compute_api_class = cinder.compute.nova.API {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] config_dir = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] config_source = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] control_exchange = openstack {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] debug = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] default_availability_zone = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] default_group_type = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] default_volume_type = QuobyteHD {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] disk_geometry = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] driver_client_cert = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] driver_client_cert_key = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] driver_data_namespace = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] driver_ssl_cert_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] driver_ssl_cert_verify = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] driver_use_ssl = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] enable_new_services = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] enable_unsupported_driver = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] enabled_backends = ['QuobyteHD'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] enforce_multipath_for_image_xfer = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] filter_function = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_api_insecure = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_api_ssl_compression = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_ca_certificates_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_catalog_info = image:glance:publicURL {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_num_retries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance_request_timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] goodness_function = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] graceful_shutdown_timeout = 5 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] group_api_class = cinder.group.api.API {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] host = devstack {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_compress_on_upload = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_conversion_address_space_limit = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_conversion_cpu_limit = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_conversion_disable = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_upload_use_cinder_backend = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_upload_use_internal_tenant = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_volume_cache_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_volume_cache_max_count = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] image_volume_cache_max_size_gb = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] init_host_max_objects_retrieval = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] instance_format = [instance: %(uuid)s] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] iscsi_target_flags = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] iscsi_write_cache = on {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] iser_helper = tgtadm {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] iser_ip_address = 192.168.122.72 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] iser_port = 3260 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_color = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_config_append = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_dir = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_options = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_rotate_interval = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Starting volume driver QuobyteDriver (1.2) Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_rotate_interval_type = days {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] log_rotation_type = none {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] max_age = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] max_logfile_count = 30 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] max_logfile_size_mb = 200 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] max_over_subscription_ratio = 20.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] message_reap_interval = 86400 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] message_ttl = 2592000 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.remotefs [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86765) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] migration_create_volume_timeout_secs = 300 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] monkey_patch = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] monkey_patch_modules = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] my_ip = 192.168.122.72 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] no_snapshot_gb_quota = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] num_iser_scan_tries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] num_shell_tries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] num_volume_device_scan_tries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] nvmeof_conn_info_version = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] nvmet_ns_id = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] nvmet_port_id = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_max_limit = 1000 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_volume_ext_list = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_volume_listen_port = 8776 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_volume_use_ssl = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] osapi_volume_workers = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] per_volume_size_limit = -1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] periodic_fuzzy_delay = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] periodic_interval = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] public_endpoint = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] publish_errors = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_backup_gigabytes = 1000 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_backups = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_gigabytes = 1000 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_groups = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_snapshots = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] quota_volumes = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] rate_limit_burst = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] rate_limit_except_level = CRITICAL {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] rate_limit_interval = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] reinit_driver_count = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] replication_device = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] report_discard_supported = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] report_interval = 120 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] reservation_clean_interval = 86400 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] reservation_expire = 86400 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] reserved_image_namespaces = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] reserved_percentage = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] rpc_response_timeout = 120 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] run_external_periodic_tasks = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] scst_target_driver = iscsi {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] scst_target_iqn_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_down_time = 720 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] shell_completion = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] snapshot_name_template = snapshot-%s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] split_loggers = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] state_path = /opt/stack/data/cinder {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] storage_availability_zone = nova {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] storage_protocol = iSCSI {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] syslog_log_facility = LOG_USER {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] target_helper = lioadm {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] target_ip_address = 192.168.122.72 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] target_port = 3260 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] target_protocol = iscsi {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] target_secondary_ip_addresses = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] trace_flags = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] transport_url = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] until_refresh = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_chap_auth = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_default_quota_class = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_journal = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_json = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_multipath_for_image_xfer = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_stderr = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] use_syslog = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] verify_glance_signatures = enabled {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_api_class = cinder.volume.api.API {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_backend_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_clear = zero {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_clear_ionice = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_clear_size = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_copy_bps_limit = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_dd_blocksize = 1M {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_name_template = volume-%s {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_service_inithost_offload = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volume_usage_audit_period = month {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] zoning_mode = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_concurrency.disable_process_locking = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.auth_section = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.auth_type = password {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.auth_version = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.cache = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.include_service_catalog = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.insecure = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.interface = public {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_password = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcache_username = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.region_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.service_type = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.backend = dogpile.cache.null {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.backend_argument = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.backend_expiration_time = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.config_prefix = cache.oslo {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.debug_cache_backend = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.enable_retry_client = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.enable_socket_keepalive = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.expiration_time = 600 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.hashclient_retry_attempts = 2 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_dead_retry = 300 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_pool_maxsize = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_sasl_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.password = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.proxies = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.redis_db = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.redis_server = localhost:6379 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.retry_attempts = 2 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.retry_delay = 0.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.socket_keepalive_count = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.socket_keepalive_idle = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.socket_keepalive_interval = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86765) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 20 16:39:29 devstack cinder-volume[86765]: WARNING cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 20 16:39:29 devstack cinder-volume[86765]: WARNING cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.socket_timeout = 1.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.tls_allowed_ciphers = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.tls_cafile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.tls_certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Running cmd (subprocess): mount.quobyte {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.tls_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.tls_keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cache.username = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] coordination.backend_url = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.asyncio_connection = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.asyncio_slave_connection = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.backend = sqlalchemy {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.connection = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.connection_debug = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.connection_parameters = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.connection_recycle_time = 3600 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.connection_trace = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.db_inc_retry_interval = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.db_max_retries = 20 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.db_max_retry_interval = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.db_retry_interval = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.max_overflow = 50 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.max_pool_size = 5 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.max_retries = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.mysql_wsrep_sync_wait = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.pool_timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.retry_interval = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.slave_connection = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.sqlite_synchronous = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.synchronous_reader = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] database.use_db_reconnect = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.connection_string = messaging:// {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.es_doc_type = notification {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.es_scroll_size = 10000 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.es_scroll_time = 2m {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.filter_error_trace = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.hmac_keys = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.sentinel_service_name = mymaster {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.socket_timeout = 0.1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.trace_requests = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler.trace_sqlalchemy = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler_jaeger.process_tags = {} {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler_jaeger.service_name_prefix = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] profiler_otlp.service_name_prefix = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.enforce_new_defaults = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.policy_default_rule = default {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.policy_file = policy.yaml {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.group = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.helper_command = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] privsep_osbrick.user = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.group = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.helper_command = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] cinder_sys_admin.user = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.auth_section = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.auth_type = password {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.cafile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.collect_timing = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.insecure = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.send_service_user_token = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.split_loggers = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] service_user.timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.auth_section = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.auth_type = password {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.collect_timing = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.insecure = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.region_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.split_loggers = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] glance.timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.backend_availability_zone = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.chap_password = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.chap_username = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.disk_geometry = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.driver_client_cert = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.driver_client_cert_key = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.driver_data_namespace = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.driver_use_ssl = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.extra_capabilities = {} {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.filter_function = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.goodness_function = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.iscsi_target_flags = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.iscsi_write_cache = on {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.iser_helper = tgtadm {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.iser_port = 3260 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_host = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_login = admin {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_mount_options = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_password = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_private_key = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_share_path = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.num_shell_tries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack quobyte-client[86770]: Reading configuration file: /etc/quobyte/client.cfg Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.quobyte_volume_url = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack quobyte-client[86770]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.replication_device = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.report_discard_supported = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.reserved_percentage = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.target_helper = tgtadm {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.target_port = 3260 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.target_protocol = iscsi {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.trace_flags = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.unique_fqdn_network = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.use_chap_auth = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_backend_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_clear = zero {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_clear_ionice = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_clear_size = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_reports.file_event_handler = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_reports.log_dir = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.backend_availability_zone = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.backend_host = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.chap_password = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.chap_username = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.chiscsi_conf = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.disk_geometry = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.driver_client_cert = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.driver_data_namespace = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.driver_use_ssl = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.extra_capabilities = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.filter_function = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.goodness_function = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=86765) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.iser_helper = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.iser_ip_address = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86765]: INFO cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 ... Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.iser_port = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.iser_target_prefix = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 -c /etc/quobyte/client-cinder.cfg {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_host = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_login = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_mount_options = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_password = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_private_key = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_share_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_ssh_port = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.num_shell_tries = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.nvmet_port_id = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.replication_device = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.report_discard_supported = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.reserved_percentage = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.scst_target_driver = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.storage_protocol = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.target_helper = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.target_ip_address = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.target_port = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.target_prefix = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.target_protocol = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.trace_flags = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.use_chap_auth = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_clear = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_clear_size = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] QuobyteHD.volumes_dir = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_notifications.driver = [] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_notifications.retry = -1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] key_manager.fixed_key = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.barbican_api_version = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.barbican_endpoint = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.barbican_endpoint_type = public {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.barbican_region_name = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.cafile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.collect_timing = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.insecure = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.number_of_retries = 60 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.retry_delay = 1 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.send_service_user_token = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.split_loggers = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.verify_ssl = True {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican.verify_ssl_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.auth_section = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.auth_type = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.cafile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.certfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.collect_timing = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.insecure = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.keyfile = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.split_loggers = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] barbican_service_user.timeout = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 -c /etc/quobyte/client-cinder.cfg Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.approle_role_id = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.approle_secret_id = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.auth_method = approle {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.auth_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.kv_mountpoint = secret {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.kv_path = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.kv_version = 2 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.namespace = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.root_token_id = **** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.ssl_ca_crt_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.timeout = 60.0 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.token_file = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.token_role = None {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.use_ssl = False {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:29 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] ******************************************************************************** {{(pid=86547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 20 16:39:30 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.426s {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:30 devstack cinder-volume[86765]: INFO cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 succeeded Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=86765) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.438s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:30 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:30 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:30 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.236s {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:30 devstack cinder-volume[86765]: INFO cinder.volume.driver [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Driver hasn't implemented _init_vendor_properties() Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.volume.driver [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86765) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_db.sqlalchemy.engines [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG dbcounter [-] [86765] Writer thread running {{(pid=86765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.db.api [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Building query based on filter {{(pid=86765) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.image.image_utils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86765) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 20 16:39:30 devstack cinder-volume[86765]: INFO cinder.keymgr.migration [None req-43b1f973-c2a8-4c05-ad16-6acd927af80b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=86765) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=86765) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:30 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:30 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:30 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.240s {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Notifying Schedulers of capabilities ... {{(pid=86765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:39:30 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Driver initialization completed successfully. Jul 20 16:39:30 devstack cinder-volume[86765]: INFO cinder.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Initiating service 3 cleanup Jul 20 16:39:30 devstack cinder-volume[86765]: INFO cinder.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Service 3 cleanup completed. Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.service [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Creating RPC server for service cinder-volume {{(pid=86765) start /opt/stack/cinder/cinder/service.py:231}} Jul 20 16:39:30 devstack cinder-volume[86765]: DEBUG cinder.service [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86765) start /opt/stack/cinder/cinder/service.py:237}} Jul 20 16:39:31 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=86765) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=86765) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:31 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:31 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:31 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:31 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.377s {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:31 devstack cinder-volume[86765]: INFO cinder.volume.manager [None req-10196651-96a0-422e-b64b-bd0cfaf56011 None None] Driver post RPC initialization completed successfully. Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=86765) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG cinder.volume.drivers.quobyte [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=86765) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86765) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:36 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:36 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:36 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG oslo_concurrency.processutils [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.228s {{(pid=86765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:36 devstack cinder-volume[86765]: DEBUG cinder.manager [None req-c8fd6c2b-cbb5-4172-a3e8-9b999f04d69e None None] Notifying Schedulers of capabilities ... {{(pid=86765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:39:37 devstack cinder-volume[86547]: INFO oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Caught SIGTERM, stopping children Jul 20 16:39:37 devstack cinder-volume[86547]: DEBUG oslo_concurrency.lockutils [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Acquiring lock "singleton_lock" {{(pid=86547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:39:37 devstack cinder-volume[86547]: DEBUG oslo_concurrency.lockutils [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Acquired lock "singleton_lock" {{(pid=86547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:39:37 devstack cinder-volume[86547]: DEBUG oslo_concurrency.lockutils [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Releasing lock "singleton_lock" {{(pid=86547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:39:37 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Stop services. {{(pid=86547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 20 16:39:37 devstack cinder-volume[86547]: DEBUG oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Killing children. {{(pid=86547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 20 16:39:37 devstack cinder-volume[86547]: INFO oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Waiting on 1 children to exit Jul 20 16:39:39 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Acquiring lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:39:39 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Acquired lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:39:39 devstack cinder-volume[86765]: DEBUG oslo_concurrency.lockutils [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Releasing lock "singleton_lock" {{(pid=86765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:39:39 devstack cinder-volume[86765]: WARNING amqp [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 20 16:39:39 devstack cinder-volume[86765]: WARNING amqp [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 20 16:39:39 devstack cinder-volume[86547]: INFO oslo_service.backend._eventlet.service [None req-bacc9f86-e122-4d9d-862a-49d344b14935 None None] Child 86765 exited with status 0 Jul 20 16:39:39 devstack cinder-volume[87223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 20 16:39:39 devstack cinder-volume[87223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 20 16:39:39 devstack cinder-volume[87223]: we strongly recommend against using it for new projects. Jul 20 16:39:39 devstack cinder-volume[87223]: If you are already using Eventlet, we recommend migrating to a different Jul 20 16:39:39 devstack cinder-volume[87223]: framework. For more detail see Jul 20 16:39:39 devstack cinder-volume[87223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 20 16:39:39 devstack cinder-volume[87223]: import eventlet # noqa Jul 20 16:39:42 devstack cinder-volume[87223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 20 16:39:42 devstack cinder-volume[87223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 20 16:39:42 devstack cinder-volume[87223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 20 16:39:44 devstack cinder-volume[87223]: INFO dbcounter [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Registered counter for database cinder Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_db.sqlalchemy.engines [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG dbcounter [-] [87223] Writer thread running {{(pid=87223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 20 16:39:44 devstack cinder-volume[87223]: INFO cinder.rpc [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 20 16:39:44 devstack cinder-volume[87223]: INFO cinder.rpc [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_db.sqlalchemy.engines [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:44 devstack cinder-volume[87223]: INFO cinder.volume.manager [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Determined volume DB was empty at startup. Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG cinder.volume.manager [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87223) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 20 16:39:44 devstack cinder-volume[87223]: WARNING stevedore.named [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 20 16:39:44 devstack cinder-volume[87223]: WARNING castellan.key_manager [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:39:44 devstack cinder-volume[87223]: WARNING cinder.keymgr.conf_key_mgr [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 20 16:39:44 devstack cinder-volume[87223]: INFO cinder.volume.manager [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_db.sqlalchemy.engines [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:44 devstack cinder-volume[87223]: INFO oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Starting 1 workers Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Started child 87535 {{(pid=87223) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Full set of CONF: {{(pid=87223) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] ******************************************************************************** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] Configuration options gathered from: {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] ================================================================================ {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] allow_availability_zone_fallback = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] allow_compression_on_image_upload = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] allowed_direct_url_schemes = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] api_rate_limit = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] auth_strategy = keystone {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_availability_zone = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_host = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_stats_polling_interval = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backup_api_class = cinder.backup.api.API {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backup_name_template = backup-%s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backup_use_same_host = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backup_use_temp_snapshot = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] chap_password = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] chap_username = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:44 devstack cinder-volume[87535]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_internal_tenant_project_id = 665b025f6e3d45a1bb55eae29f95f9b9 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_internal_tenant_user_id = b6c87ac2475a43919730766fa19ac79d {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cluster = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] compression_format = gzip {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] compute_api_class = cinder.compute.nova.API {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] config_dir = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] config_source = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] control_exchange = openstack {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] debug = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] default_availability_zone = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] default_group_type = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] default_volume_type = QuobyteHD {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] disk_geometry = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] driver_client_cert = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] driver_client_cert_key = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] driver_data_namespace = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] driver_ssl_cert_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] driver_ssl_cert_verify = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] driver_use_ssl = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] enable_new_services = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] enable_unsupported_driver = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] enabled_backends = ['QuobyteHD'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] enforce_multipath_for_image_xfer = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] filter_function = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_api_insecure = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_api_ssl_compression = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_ca_certificates_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_catalog_info = image:glance:publicURL {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_num_retries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance_request_timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] goodness_function = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] graceful_shutdown_timeout = 5 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] group_api_class = cinder.group.api.API {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] host = devstack {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_compress_on_upload = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_conversion_address_space_limit = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_conversion_cpu_limit = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_conversion_disable = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_upload_use_cinder_backend = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_upload_use_internal_tenant = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_volume_cache_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_volume_cache_max_count = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] image_volume_cache_max_size_gb = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] init_host_max_objects_retrieval = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] instance_format = [instance: %(uuid)s] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] iscsi_target_flags = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] iscsi_write_cache = on {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] iser_helper = tgtadm {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] iser_ip_address = 192.168.122.72 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] iser_port = 3260 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_color = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_config_append = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_dir = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_options = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_rotate_interval = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_rotate_interval_type = days {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] log_rotation_type = none {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] max_age = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] max_logfile_count = 30 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] max_logfile_size_mb = 200 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] max_over_subscription_ratio = 20.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] message_reap_interval = 86400 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] message_ttl = 2592000 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Starting volume driver QuobyteDriver (1.2) Jul 20 16:39:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87535) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] migration_create_volume_timeout_secs = 300 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] monkey_patch = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] monkey_patch_modules = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] my_ip = 192.168.122.72 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] no_snapshot_gb_quota = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] num_iser_scan_tries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] num_shell_tries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] num_volume_device_scan_tries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] nvmeof_conn_info_version = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] nvmet_ns_id = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] nvmet_port_id = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_max_limit = 1000 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_volume_ext_list = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_volume_listen = 0.0.0.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_volume_listen_port = 8776 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_volume_use_ssl = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] osapi_volume_workers = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] per_volume_size_limit = -1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] periodic_fuzzy_delay = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] periodic_interval = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] project_id_regex = [0-9a-f\-]+ {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] public_endpoint = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] publish_errors = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_backup_gigabytes = 1000 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_backups = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_gigabytes = 1000 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_groups = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_snapshots = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] quota_volumes = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] rate_limit_burst = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] rate_limit_except_level = CRITICAL {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] rate_limit_interval = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] reinit_driver_count = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] replication_device = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] report_discard_supported = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] report_interval = 120 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] reservation_clean_interval = 86400 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] reservation_expire = 86400 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] reserved_image_namespaces = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] reserved_percentage = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] rpc_response_timeout = 120 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] run_external_periodic_tasks = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] scst_target_driver = iscsi {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] scst_target_iqn_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_down_time = 720 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] shell_completion = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] snapshot_name_template = snapshot-%s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] split_loggers = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] state_path = /opt/stack/data/cinder {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] storage_availability_zone = nova {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] storage_protocol = iSCSI {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] syslog_log_facility = LOG_USER {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] target_helper = lioadm {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] target_ip_address = 192.168.122.72 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] target_port = 3260 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] target_protocol = iscsi {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] target_secondary_ip_addresses = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] trace_flags = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] transfer_api_class = cinder.transfer.api.API {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] transport_url = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] until_refresh = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_chap_auth = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_default_quota_class = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_journal = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_json = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_multipath_for_image_xfer = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_stderr = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] use_syslog = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] verify_glance_signatures = enabled {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_api_class = cinder.volume.api.API {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_backend_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_clear = zero {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_clear_ionice = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_clear_size = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_copy_bps_limit = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_dd_blocksize = 1M {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_name_template = volume-%s {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_service_inithost_offload = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volume_usage_audit_period = month {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] zoning_mode = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_concurrency.disable_process_locking = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.auth_section = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.auth_type = password {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.auth_version = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.cache = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.delay_auth_decision = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.http_connect_timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.include_service_catalog = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.insecure = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.interface = public {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_password = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcache_username = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.region_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.service_token_roles_required = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.service_type = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.token_cache_time = 300 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.backend = dogpile.cache.null {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.backend_argument = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.backend_expiration_time = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.config_prefix = cache.oslo {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.debug_cache_backend = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.enable_retry_client = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.enable_socket_keepalive = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.expiration_time = 600 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.hashclient_retry_attempts = 2 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_dead_retry = 300 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_pool_maxsize = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_sasl_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.password = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.proxies = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.redis_db = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.redis_sentinel_service_name = mymaster {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.redis_server = localhost:6379 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87535) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 20 16:39:45 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 20 16:39:45 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.retry_attempts = 2 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.retry_delay = 0.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.socket_keepalive_count = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.socket_keepalive_idle = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.socket_keepalive_interval = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.socket_timeout = 1.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.tls_allowed_ciphers = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Running cmd (subprocess): mount.quobyte {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.tls_cafile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.tls_certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.tls_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.tls_keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cache.username = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] coordination.backend_url = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:45 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.asyncio_connection = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.asyncio_slave_connection = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.backend = sqlalchemy {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.connection = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.connection_debug = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.connection_parameters = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.connection_recycle_time = 3600 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.connection_trace = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.db_inc_retry_interval = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.db_max_retries = 20 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.db_max_retry_interval = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.db_retry_interval = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.max_overflow = 50 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.max_pool_size = 5 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.max_retries = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.mysql_wsrep_sync_wait = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.pool_timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.retry_interval = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.slave_connection = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.sqlite_synchronous = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.synchronous_reader = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] database.use_db_reconnect = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.connection_string = messaging:// {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.es_doc_type = notification {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.es_scroll_size = 10000 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.es_scroll_time = 2m {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.filter_error_trace = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.hmac_keys = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.sentinel_service_name = mymaster {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.socket_timeout = 0.1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.trace_requests = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler.trace_sqlalchemy = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler_jaeger.process_tags = {} {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler_jaeger.service_name_prefix = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] profiler_otlp.service_name_prefix = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.enforce_new_defaults = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.policy_default_rule = default {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.policy_file = policy.yaml {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_policy.remote_timeout = 60.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.group = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.helper_command = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] privsep_osbrick.user = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.group = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.helper_command = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] cinder_sys_admin.user = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.auth_section = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.auth_type = password {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.cafile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.collect_timing = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.insecure = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.send_service_user_token = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.split_loggers = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] service_user.timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.auth_section = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.auth_type = password {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.collect_timing = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.insecure = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.region_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.split_loggers = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] glance.timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.backend_availability_zone = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.chap_password = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.chap_username = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.disk_geometry = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.driver_client_cert = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.driver_client_cert_key = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.driver_data_namespace = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.driver_use_ssl = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.enable_unsupported_driver = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.extra_capabilities = {} {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.filter_function = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.goodness_function = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.iscsi_target_flags = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.iscsi_write_cache = on {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.iser_helper = tgtadm {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.iser_port = 3260 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_host = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_login = admin {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_mount_options = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_password = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_private_key = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_share_path = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_ssh_port = 22 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.num_shell_tries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.nvmet_port_id = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_client_cfg = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.quobyte_volume_url = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.replication_device = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.report_discard_supported = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.reserved_percentage = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.scst_target_driver = iscsi {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.scst_target_iqn_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.storage_protocol = iSCSI {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.target_helper = tgtadm {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.target_port = 3260 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.target_protocol = iscsi {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.trace_flags = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.unique_fqdn_network = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.use_chap_auth = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_backend_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_clear = zero {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_clear_ionice = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_clear_size = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_reports.file_event_handler = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] CMD "mount.quobyte" returned: 1 in 0.155s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_reports.log_dir = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.backend_availability_zone = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.backend_host = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.chap_password = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.chap_username = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.chiscsi_conf = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.disk_geometry = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.driver_client_cert = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.driver_client_cert_key = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.driver_data_namespace = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.driver_use_ssl = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.extra_capabilities = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.filter_function = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.goodness_function = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.iscsi_target_flags = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.iscsi_write_cache = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.iser_helper = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.iser_ip_address = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.iser_port = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.iser_target_prefix = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_host = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_login = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_mount_options = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_password = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_private_key = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_share_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_ssh_port = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.num_shell_tries = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nvmet_ns_id = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.nvmet_port_id = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.replication_device = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.report_discard_supported = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.reserved_percentage = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.scst_target_driver = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.storage_protocol = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.target_helper = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.target_ip_address = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.target_port = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.target_prefix = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.target_protocol = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.trace_flags = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.unique_fqdn_network = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.use_chap_auth = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:46 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_clear = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_clear_ionice = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_clear_size = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] QuobyteHD.volumes_dir = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.ssl_version = {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_notifications.driver = [] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_notifications.retry = -1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] oslo_messaging_notifications.transport_url = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] key_manager.fixed_key = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.barbican_api_version = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.barbican_endpoint = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.barbican_endpoint_type = public {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.barbican_region_name = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.cafile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.collect_timing = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.insecure = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.number_of_retries = 60 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.retry_delay = 1 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.send_service_user_token = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.split_loggers = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.verify_ssl = True {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican.verify_ssl_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.auth_section = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.auth_type = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.cafile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.certfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.collect_timing = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.insecure = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.keyfile = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.split_loggers = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] barbican_service_user.timeout = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.approle_role_id = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.approle_secret_id = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.auth_method = approle {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.auth_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.kv_mountpoint = secret {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.kv_path = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.kv_version = 2 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.namespace = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.root_token_id = **** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.ssl_ca_crt_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.timeout = 60.0 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.token_file = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.token_role = None {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.use_ssl = False {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 20 16:39:46 devstack cinder-volume[87223]: DEBUG oslo_service.backend._eventlet.service [None req-31b753fa-13bb-4a27-a729-7881a8b8f45b None None] ******************************************************************************** {{(pid=87223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.500s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:46 devstack cinder-volume[87535]: INFO cinder.volume.driver [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Driver hasn't implemented _init_vendor_properties() Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.driver [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87535) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_db.sqlalchemy.engines [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87535) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writer thread running {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.db.api [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Building query based on filter {{(pid=87535) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87535) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:46 devstack cinder-volume[87535]: INFO cinder.keymgr.migration [None req-bc5e04bb-3ee8-480c-9cae-419ca60b656f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.378s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:39:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Driver initialization completed successfully. Jul 20 16:39:46 devstack cinder-volume[87535]: INFO cinder.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Initiating service 3 cleanup Jul 20 16:39:46 devstack cinder-volume[87535]: INFO cinder.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Service 3 cleanup completed. Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.service [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Creating RPC server for service cinder-volume {{(pid=87535) start /opt/stack/cinder/cinder/service.py:231}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.service [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87535) start /opt/stack/cinder/cinder/service.py:237}} Jul 20 16:39:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:39:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:39:46 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:39:46 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:39:47 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Jul 20 16:39:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.319s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:39:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-251dc6a4-df23-4b92-aa54-436349a1ac9f None None] Driver post RPC initialization completed successfully. Jul 20 16:39:54 devstack cinder-volume[87223]: DEBUG dbcounter [-] [87223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:39:56 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:39:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=4 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:40:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:40:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 6 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:40:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Flow 'volume_create_manager' (0d5a4ba1-ae02-4fd9-9ed6-e3400aed8eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9816681-6be4-4569-8a7d-425a6c123102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9816681-6be4-4569-8a7d-425a6c123102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2070906581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983dcada-6e53-474a-bd7c-22c553877e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c26ab41c664f1fb8e5b666f091d127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:40:47Z,use_quota=True,user_id='03d405eacac747c7b42b6eb8d1530482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dee46a-e933-41cc-bded-d01a598f31ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dee46a-e933-41cc-bded-d01a598f31ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864f421e-7179-47b0-a007-b6fa6a5c9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864f421e-7179-47b0-a007-b6fa6a5c9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983dcada-6e53-474a-bd7c-22c553877e29', 'volume_name': 'volume-983dcada-6e53-474a-bd7c-22c553877e29', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe3753d-8fa9-462e-8225-8bd7a3a960aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe3753d-8fa9-462e-8225-8bd7a3a960aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53958f77-380f-4077-bfcb-b38eb69cc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Volume 983dcada-6e53-474a-bd7c-22c553877e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983dcada-6e53-474a-bd7c-22c553877e29', 'volume_size': 1} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2070906581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983dcada-6e53-474a-bd7c-22c553877e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09c26ab41c664f1fb8e5b666f091d127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:40:47Z,use_quota=True,user_id='03d405eacac747c7b42b6eb8d1530482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Creating volume 983dcada-6e53-474a-bd7c-22c553877e29 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:40:47 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:40:47 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 1073741824 Jul 20 16:40:47 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Flow 'volume_create_manager' (257d8766-2f0f-4e22-ac98-a28a236120e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e326be1c-d9a4-4516-bf82-643935c5c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e326be1c-d9a4-4516-bf82-643935c5c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1184920420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab1c25c-45d6-47b5-abbf-277ac6feac29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5413676141f4e69a18cd697844f5258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:40:47Z,use_quota=True,user_id='216f001841ad4526aea2ea77e1508365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b026ac5-dcfa-4647-a7f9-039ea5e41c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b026ac5-dcfa-4647-a7f9-039ea5e41c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4937ca18-203b-4095-ac5a-9fa4aae828ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4937ca18-203b-4095-ac5a-9fa4aae828ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab1c25c-45d6-47b5-abbf-277ac6feac29', 'volume_name': 'volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f882ff7-af3f-4b31-987a-f02e782f2971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f882ff7-af3f-4b31-987a-f02e782f2971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88d04dd-219b-4f2b-812e-28f2d3550ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:47 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Volume 9ab1c25c-45d6-47b5-abbf-277ac6feac29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29', 'volume_size': 1} Jul 20 16:40:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:48 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 1073741824" returned: 0 in 1.432s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:48 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 Jul 20 16:40:48 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:49 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29" returned: 0 in 0.439s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1184920420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab1c25c-45d6-47b5-abbf-277ac6feac29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5413676141f4e69a18cd697844f5258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:40:47Z,use_quota=True,user_id='216f001841ad4526aea2ea77e1508365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Creating volume 9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:40:49 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53958f77-380f-4077-bfcb-b38eb69cc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983dcada-6e53-474a-bd7c-22c553877e29', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:49 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 1073741824 Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99507240-a9d0-44b8-9cd0-9a47f950d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:49 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:49 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Volume volume-983dcada-6e53-474a-bd7c-22c553877e29 (983dcada-6e53-474a-bd7c-22c553877e29): created successfully Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99507240-a9d0-44b8-9cd0-9a47f950d81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Flow 'volume_create_manager' (0d5a4ba1-ae02-4fd9-9ed6-e3400aed8eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:40:49 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a17356bb-3411-472e-ad06-64e3a9fc1972 tempest-DeleteServersTestJSON-601286246 None] Created volume successfully. Jul 20 16:40:50 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 1073741824" returned: 0 in 1.091s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:50 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 Jul 20 16:40:50 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:50 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29" returned: 0 in 0.532s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:40:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88d04dd-219b-4f2b-812e-28f2d3550ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a15952-d24c-4163-bcfa-79b212281509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:51 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Volume volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 (9ab1c25c-45d6-47b5-abbf-277ac6feac29): created successfully Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a15952-d24c-4163-bcfa-79b212281509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Flow 'volume_create_manager' (257d8766-2f0f-4e22-ac98-a28a236120e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:40:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-6891c5ed-bbcf-4fb2-81ed-30ed44209c1d req-39a52570-2242-4045-9922-a485ab051c1c tempest-VolumesSnapshotsTestJSON-233382909 None] Created volume successfully. Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Flow 'volume_create_manager' (ee9e2103-791f-4eef-bf7c-6a61824f3551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234bd58d-003c-46af-b5ea-2ddc335c1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234bd58d-003c-46af-b5ea-2ddc335c1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1250368651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fd7266-16d1-4613-8ba4-04c1de08c3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3553a75c86f46a298f601c4ee5db92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:40:51Z,use_quota=True,user_id='9cbc0993c07641d892f151037ed0a52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255554a9-ce47-4d13-a7c5-c4aaa6d36783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255554a9-ce47-4d13-a7c5-c4aaa6d36783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba62f53b-8f34-4bf8-9067-8fa97b962b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba62f53b-8f34-4bf8-9067-8fa97b962b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fd7266-16d1-4613-8ba4-04c1de08c3d8', 'volume_name': 'volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28765f47-42eb-406f-a680-c85104ff55b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28765f47-42eb-406f-a680-c85104ff55b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931d71bb-4cdf-441c-abc3-ba25febf5e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:51 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Volume 58fd7266-16d1-4613-8ba4-04c1de08c3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8', 'volume_size': 1} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1250368651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fd7266-16d1-4613-8ba4-04c1de08c3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3553a75c86f46a298f601c4ee5db92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:40:51Z,use_quota=True,user_id='9cbc0993c07641d892f151037ed0a52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Creating volume 58fd7266-16d1-4613-8ba4-04c1de08c3d8 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:40:51 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:40:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:51 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 1073741824 Jul 20 16:40:51 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:52 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 1073741824" returned: 0 in 1.110s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:52 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 Jul 20 16:40:52 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:53 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8" returned: 0 in 0.489s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.256s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931d71bb-4cdf-441c-abc3-ba25febf5e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9a633a-977b-4fe0-ac75-43d1c64be954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Creating offline snapshot 42285c01-df0c-4023-a316-d6a8459f58a8 of volume 9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:40:53 devstack cinder-volume[87535]: INFO oslo.privsep.daemon [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2dq34q9d/privsep.sock'] Jul 20 16:40:53 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Volume volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 (58fd7266-16d1-4613-8ba4-04c1de08c3d8): created successfully Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9a633a-977b-4fe0-ac75-43d1c64be954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:40:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Flow 'volume_create_manager' (ee9e2103-791f-4eef-bf7c-6a61824f3551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:40:53 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2dq34q9d/privsep.sock Jul 20 16:40:53 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:53 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-280b83d8-fc4d-4dcc-8598-5e3008c5280c tempest-VolumesAdminNegativeTest-350222474 None] Created volume successfully. Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING py.warnings [req-8e5e0e91-ada8-48e2-8c2b-0c168febf006 req-712a6d46-f5a0-47f8-b633-e60470993510 tempest-DeleteServersTestJSON-601286246 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 20 16:40:55 devstack cinder-volume[87535]: .first() Jul 20 16:40:55 devstack cinder-volume[87535]: Jul 20 16:40:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-8e5e0e91-ada8-48e2-8c2b-0c168febf006 req-712a6d46-f5a0-47f8-b633-e60470993510 tempest-DeleteServersTestJSON-601286246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Acquiring lock "cinder-58fd7266-16d1-4613-8ba4-04c1de08c3d8-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:40:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Lock "cinder-58fd7266-16d1-4613-8ba4-04c1de08c3d8-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:40:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Acquiring lock "cinder-quobyte-58fd7266-16d1-4613-8ba4-04c1de08c3d8" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:40:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Lock "cinder-quobyte-58fd7266-16d1-4613-8ba4-04c1de08c3d8" acquired by "delete_volume" :: waited 0.041s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: Jul 20 16:40:55 devstack cinder-volume[87535]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 20 16:40:56 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:56 devstack cinder-volume[87535]: INFO oslo.privsep.daemon [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Spawned new privsep daemon via rootwrap Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Accepted privsep connection to /tmp/tmp2dq34q9d/privsep.sock {{(pid=87535) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 20 16:40:56 devstack cinder-volume[87535]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 20 16:40:56 devstack cinder-volume[87535]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 20 16:40:56 devstack cinder-volume[87535]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 20 16:40:56 devstack cinder-volume[87535]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88433 Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[393403a0-795a-484e-96c7-c6ec7cdc9e31]: (2,) {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:40:56 devstack cinder-volume[87535]: WARNING oslo_privsep.priv_context [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] privsep daemon already running Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[19015972-ef43-4fe6-abf4-2d537b19622c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c88f1-bcaf-4eba-8d44-196d6b0d9e07]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:56 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 Jul 20 16:40:56 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:56 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 Jul 20 16:40:56 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:56 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8" returned: 0 in 0.595s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:56 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8 Jul 20 16:40:56 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:57 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29" returned: 0 in 0.946s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:57 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 1G Jul 20 16:40:57 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:57 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58fd7266-16d1-4613-8ba4-04c1de08c3d8" returned: 0 in 0.468s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Lock "cinder-quobyte-58fd7266-16d1-4613-8ba4-04c1de08c3d8" released by "delete_volume" :: held 1.603s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:40:57 devstack cinder-volume[87535]: WARNING cinder.quota [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:40:57 devstack cinder-volume[87535]: WARNING cinder.quota [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Created reservations ['9cdd5b6e-ac54-4a66-b9e3-110041ebe63b', '5568c048-d988-491d-80a4-1fa3f2ec2e73', '20a595f5-bddd-44fd-ac9a-83f54ff97fd4', '0dc7fc7b-2fda-448d-aba1-dd7ea816a590'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:57 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:40:57 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:57 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 1G" returned: 0 in 0.843s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:57 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.506s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:57 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:40:57 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 Jul 20 16:40:57 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:57 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Deleted volume successfully. Jul 20 16:40:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e3915382-6774-40c5-b72a-2b308bf70236 tempest-VolumesAdminNegativeTest-350222474 None] Lock "cinder-58fd7266-16d1-4613-8ba4-04c1de08c3d8-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:40:58 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8" returned: 0 in 0.518s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:58 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 is being set with open permissions: ugo+rw Jul 20 16:40:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:58 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 Jul 20 16:40:58 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:58 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8" returned: 0 in 0.482s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:59 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info Jul 20 16:40:59 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:59 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:59 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info is being set with open permissions: ugo+rw Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:40:59 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info Jul 20 16:40:59 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:40:59 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.info" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.397s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-8e5e0e91-ada8-48e2-8c2b-0c168febf006 req-712a6d46-f5a0-47f8-b633-e60470993510 tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.560s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-8e5e0e91-ada8-48e2-8c2b-0c168febf006 req-712a6d46-f5a0-47f8-b633-e60470993510 tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:40:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-03f6a3e0-3d7d-435d-bf7e-7a5bd8a88d65 req-60209ca2-b925-4258-82a6-dd9fd70fc714 tempest-VolumesSnapshotsTestJSON-233382909 None] Create snapshot completed successfully Jul 20 16:40:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-8e5e0e91-ada8-48e2-8c2b-0c168febf006 req-712a6d46-f5a0-47f8-b633-e60470993510 tempest-DeleteServersTestJSON-601286246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-983dcada-6e53-474a-bd7c-22c553877e29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16a01e39-024f-4439-a10b-d5d5a6e4e96a', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:40:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-8e5e0e91-ada8-48e2-8c2b-0c168febf006 req-712a6d46-f5a0-47f8-b633-e60470993510 tempest-DeleteServersTestJSON-601286246 None] attachment_update completed successfully. Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "cinder-42285c01-df0c-4023-a316-d6a8459f58a8-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-42285c01-df0c-4023-a316-d6a8459f58a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "cinder-quobyte-9ab1c25c-45d6-47b5-abbf-277ac6feac29" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-quobyte-9ab1c25c-45d6-47b5-abbf-277ac6feac29" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "cinder-quobyte-42285c01-df0c-4023-a316-d6a8459f58a8" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-quobyte-42285c01-df0c-4023-a316-d6a8459f58a8" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Deleting offline snapshot 42285c01-df0c-4023-a316-d6a8459f58a8 of volume 9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] snapshot_file for this snap is: volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b7c0a-fcd9-42e7-a27d-a1e874f7b9b6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:00 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 Jul 20 16:41:00 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:00 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8" returned: 0 in 0.550s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[36470b9c-8d46-45c8-b17c-2bad1f05dfb1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:01 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 Jul 20 16:41:01 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:01 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29" returned: 0 in 0.610s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:01 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 Jul 20 16:41:01 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:01 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8" returned: 0 in 0.485s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:01 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8 Jul 20 16:41:01 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:02 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29.42285c01-df0c-4023-a316-d6a8459f58a8" returned: 0 in 0.422s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:02 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-quobyte-42285c01-df0c-4023-a316-d6a8459f58a8" released by "_delete_snapshot" :: held 2.266s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:02 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-quobyte-9ab1c25c-45d6-47b5-abbf-277ac6feac29" released by "delete_snapshot" :: held 2.314s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:02 devstack cinder-volume[87535]: WARNING cinder.quota [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:41:02 devstack cinder-volume[87535]: DEBUG cinder.quota [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Created reservations ['103ac759-a6ee-46e6-b3a5-dbe97daf134b', 'ab9efcf9-e300-4185-b85a-5bb7ffcae2e3', '8638ecf2-8784-4646-b6ea-f6c0ecea6d74', '8f1582fb-2d25-48ec-bc8f-525f8028f28c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Delete snapshot completed successfully. Jul 20 16:41:02 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-a00983b1-7b51-4523-8844-674806edee56 req-716711a1-d465-4f73-bebb-86852ae3fcab tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-42285c01-df0c-4023-a316-d6a8459f58a8-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-8f1f9112-0af6-4849-baab-e1ebb714cead req-4e1a1d27-514a-4b31-901d-f45fa9a6a889 tempest-DeleteServersTestJSON-601286246 None] Terminate volume connection completed successfully. Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-8f1f9112-0af6-4849-baab-e1ebb714cead req-4e1a1d27-514a-4b31-901d-f45fa9a6a889 tempest-DeleteServersTestJSON-601286246 None] Deleting attachment 16a01e39-024f-4439-a10b-d5d5a6e4e96a. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "cinder-9ab1c25c-45d6-47b5-abbf-277ac6feac29-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-9ab1c25c-45d6-47b5-abbf-277ac6feac29-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "cinder-quobyte-9ab1c25c-45d6-47b5-abbf-277ac6feac29" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-quobyte-9ab1c25c-45d6-47b5-abbf-277ac6feac29" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051c001-6f86-43e0-899c-4a46642431ec]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:03 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 Jul 20 16:41:03 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:04 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29" returned: 0 in 0.460s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:04 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29 Jul 20 16:41:04 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:04 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ab1c25c-45d6-47b5-abbf-277ac6feac29" returned: 0 in 0.340s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-quobyte-9ab1c25c-45d6-47b5-abbf-277ac6feac29" released by "delete_volume" :: held 0.895s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG cinder.quota [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Created reservations ['86a5c39d-503b-4977-bc25-0f0b81bdc3fc', '21eb54b7-f4f6-40f0-b9cc-f4bcced66c2a', 'f19eb7e6-dcb3-43ab-aac0-a7ea3e6f6b4a', 'bf827ee0-8421-4ab8-a7fc-9fb53077cac1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:04 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:04 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Acquiring lock "cinder-983dcada-6e53-474a-bd7c-22c553877e29-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Lock "cinder-983dcada-6e53-474a-bd7c-22c553877e29-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:05 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG cinder.manager [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Deleted volume successfully. Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Acquiring lock "cinder-quobyte-983dcada-6e53-474a-bd7c-22c553877e29" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-e14e04f6-94c1-4e2a-81f5-5548e8e96bb9 req-bb5892de-faaa-4586-86a0-46d4ed44a7b8 tempest-VolumesSnapshotsTestJSON-233382909 None] Lock "cinder-9ab1c25c-45d6-47b5-abbf-277ac6feac29-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Lock "cinder-quobyte-983dcada-6e53-474a-bd7c-22c553877e29" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01771c-5e89-41c4-a31d-96881fc18454]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:05 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 Jul 20 16:41:05 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:05 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29" returned: 0 in 0.506s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:05 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29 Jul 20 16:41:05 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:06 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-983dcada-6e53-474a-bd7c-22c553877e29" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Lock "cinder-quobyte-983dcada-6e53-474a-bd7c-22c553877e29" released by "delete_volume" :: held 0.893s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Created reservations ['9c5e900b-53e6-43f4-8ff9-397b52eb5d0a', '794e6346-1760-43f0-a1d9-73959f375e26', 'd08c1613-3596-43a8-8e65-a211a068212d', '04a28796-3095-40a5-8169-584671522fc7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:06 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:06 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:06 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Deleted volume successfully. Jul 20 16:41:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2cae7a68-026c-447c-b03f-cf5e25aa726a tempest-DeleteServersTestJSON-601286246 None] Lock "cinder-983dcada-6e53-474a-bd7c-22c553877e29-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Flow 'volume_create_manager' (9429a6e7-eaf9-4a47-bb96-082aad82c7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6994c90-9aca-408e-92a3-7a69367fd646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6994c90-9aca-408e-92a3-7a69367fd646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-247387036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ae78ed-a4a4-4050-9c8d-04e553294724,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b9e552cb55d4522834d579d16ad8abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:12Z,use_quota=True,user_id='730140cd412749ce9acdaaca26fb4e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9e1e64-74f6-426c-b01d-4b3b09a4ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9e1e64-74f6-426c-b01d-4b3b09a4ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2ff92d-3473-444a-a852-6efb2e8a72cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2ff92d-3473-444a-a852-6efb2e8a72cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ae78ed-a4a4-4050-9c8d-04e553294724', 'volume_name': 'volume-60ae78ed-a4a4-4050-9c8d-04e553294724', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e77a26-b173-4825-8f19-fa42df48c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66e77a26-b173-4825-8f19-fa42df48c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbadd968-06fd-4eb6-bf92-9abeaa256bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:11 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Volume 60ae78ed-a4a4-4050-9c8d-04e553294724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ae78ed-a4a4-4050-9c8d-04e553294724', 'volume_size': 1} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-247387036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ae78ed-a4a4-4050-9c8d-04e553294724,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b9e552cb55d4522834d579d16ad8abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:12Z,use_quota=True,user_id='730140cd412749ce9acdaaca26fb4e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Creating volume 60ae78ed-a4a4-4050-9c8d-04e553294724 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:41:11 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:41:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:12 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 1073741824 Jul 20 16:41:12 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:12 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 1073741824" returned: 0 in 0.519s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:12 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 Jul 20 16:41:12 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:12 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724" returned: 0 in 0.272s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbadd968-06fd-4eb6-bf92-9abeaa256bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ae78ed-a4a4-4050-9c8d-04e553294724', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6439b-8869-4f2f-bab2-e712886effcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Volume volume-60ae78ed-a4a4-4050-9c8d-04e553294724 (60ae78ed-a4a4-4050-9c8d-04e553294724): created successfully Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df6439b-8869-4f2f-bab2-e712886effcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Flow 'volume_create_manager' (9429a6e7-eaf9-4a47-bb96-082aad82c7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-6c2b8acd-3785-4faf-912a-0701a8c66cbb req-41257206-0c87-44a7-bf38-1df049b779f9 tempest-VolumesGetTestJSON-1493205556 None] Created volume successfully. Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Acquiring lock "cinder-60ae78ed-a4a4-4050-9c8d-04e553294724-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Lock "cinder-60ae78ed-a4a4-4050-9c8d-04e553294724-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Acquiring lock "cinder-quobyte-60ae78ed-a4a4-4050-9c8d-04e553294724" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Lock "cinder-quobyte-60ae78ed-a4a4-4050-9c8d-04e553294724" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[481fa927-8429-4efc-8772-36069c4a3219]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:13 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 Jul 20 16:41:13 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:13 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:13 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724 Jul 20 16:41:13 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:14 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-60ae78ed-a4a4-4050-9c8d-04e553294724" returned: 0 in 0.293s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Lock "cinder-quobyte-60ae78ed-a4a4-4050-9c8d-04e553294724" released by "delete_volume" :: held 0.736s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG cinder.quota [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Created reservations ['4120e153-4911-4a95-a8de-b2d2859cf572', '8dab0d6e-9eeb-4f08-b912-239f943c6691', '68f71a95-62de-4c83-b938-eedc645f0847', 'f03756bc-b887-48dc-a78f-1d07ecea220a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:14 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:14 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:14 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.272s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG cinder.manager [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Deleted volume successfully. Jul 20 16:41:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-f1802898-7f99-4743-806c-d49c19aadaf1 req-50a4bfca-61e5-44fe-a98e-aaabd06e5a8b tempest-VolumesGetTestJSON-1493205556 None] Lock "cinder-60ae78ed-a4a4-4050-9c8d-04e553294724-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-95302ee9-f907-4633-a96f-280a52042558 tempest-GroupsTest-375634634 None] Group tempest-Group1-1528929187: creating Jul 20 16:41:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-95302ee9-f907-4633-a96f-280a52042558 tempest-GroupsTest-375634634 None] Group tempest-Group1-1528929187: created successfully Jul 20 16:41:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-95302ee9-f907-4633-a96f-280a52042558 tempest-GroupsTest-375634634 None] Create group completed successfully. Jul 20 16:41:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-70417b9a-4d34-4013-a8c8-4816d10ef707 tempest-GroupsTest-375634634 None] Group tempest-Group2-600842886: creating Jul 20 16:41:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-70417b9a-4d34-4013-a8c8-4816d10ef707 tempest-GroupsTest-375634634 None] Group tempest-Group2-600842886: created successfully Jul 20 16:41:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-70417b9a-4d34-4013-a8c8-4816d10ef707 tempest-GroupsTest-375634634 None] Create group completed successfully. Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Flow 'volume_create_manager' (494d008d-9c95-43d4-8779-98f4ea6f0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a32a89-e5aa-40b3-8f3d-9f700ac52643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a32a89-e5aa-40b3-8f3d-9f700ac52643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1263563268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dfeea9f-34f7-4461-a3cf-b6c5b1257a05,host='devstack@QuobyteHD#QuobyteHD',id=27740e64-36fc-4cde-b465-ecbc6a4f0f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd3b9dbe1024ffa9b37b66d2d93a514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:24Z,use_quota=True,user_id='1bbc7272811d4ea48a9c8b88b813f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a477849-9a31-4fc7-8204-bd2680163cf8),volume_type_id=4a477849-9a31-4fc7-8204-bd2680163cf8)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc661f46-b7b0-49a2-b1dd-2eb162c0acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc661f46-b7b0-49a2-b1dd-2eb162c0acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c244a-459f-4b69-9d98-a052c2448b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1c244a-459f-4b69-9d98-a052c2448b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27740e64-36fc-4cde-b465-ecbc6a4f0f75', 'volume_name': 'volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c79557d-5534-4d9d-b634-93ea10e251b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c79557d-5534-4d9d-b634-93ea10e251b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdfea104-09f5-4401-aa85-d7a1365bc472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:24 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Volume 27740e64-36fc-4cde-b465-ecbc6a4f0f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75', 'volume_size': 1} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8dfeea9f-34f7-4461-a3cf-b6c5b1257a05,created_at=2026-07-20T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1263563268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dfeea9f-34f7-4461-a3cf-b6c5b1257a05,host='devstack@QuobyteHD#QuobyteHD',id=27740e64-36fc-4cde-b465-ecbc6a4f0f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd3b9dbe1024ffa9b37b66d2d93a514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:24Z,use_quota=True,user_id='1bbc7272811d4ea48a9c8b88b813f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a477849-9a31-4fc7-8204-bd2680163cf8),volume_type_id=4a477849-9a31-4fc7-8204-bd2680163cf8)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Creating volume 27740e64-36fc-4cde-b465-ecbc6a4f0f75 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:41:24 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:41:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:24 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 1073741824 Jul 20 16:41:24 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:25 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 1073741824" returned: 0 in 0.585s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:25 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 Jul 20 16:41:25 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:25 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75" returned: 0 in 0.376s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdfea104-09f5-4401-aa85-d7a1365bc472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca90d436-6e80-4e08-a414-caa1fb33e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:25 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Volume volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 (27740e64-36fc-4cde-b465-ecbc6a4f0f75): created successfully Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca90d436-6e80-4e08-a414-caa1fb33e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Flow 'volume_create_manager' (494d008d-9c95-43d4-8779-98f4ea6f0d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cd2109eb-0738-4fca-ac80-8ad1806c82e9 tempest-GroupsTest-375634634 None] Created volume successfully. Jul 20 16:41:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Acquiring lock "cinder-quobyte-27740e64-36fc-4cde-b465-ecbc6a4f0f75" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Lock "cinder-quobyte-27740e64-36fc-4cde-b465-ecbc6a4f0f75" acquired by "delete_volume" :: waited 0.035s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e6dde0-0485-4d4f-8a8a-a1e374ea23d8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:27 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 Jul 20 16:41:27 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:27 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75" returned: 0 in 0.441s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:27 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75 Jul 20 16:41:27 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:27 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-27740e64-36fc-4cde-b465-ecbc6a4f0f75" returned: 0 in 0.302s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Lock "cinder-quobyte-27740e64-36fc-4cde-b465-ecbc6a4f0f75" released by "delete_volume" :: held 0.824s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Created reservations ['5d36f704-d4d7-4b06-ac29-e95678a0424d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:27 devstack cinder-volume[87535]: WARNING cinder.quota [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-674559444 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-674559444, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:41:27 devstack cinder-volume[87535]: WARNING cinder.quota [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-674559444 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-674559444, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Created reservations ['2ab0ce1c-e3d9-458e-add0-99c475b17d23', '33ebe184-e1fc-432c-8214-11c762e4232c', 'bac43e1b-3cae-40a4-872a-01896dd19ef4', '2aebe8cd-0d83-499f-9446-649448fde77b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:27 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:27 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Created reservations ['25d412c6-8f1a-494c-9d67-26e38801798b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:28 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0b5ed1f2-edb8-48cc-a418-533bb8aa223c tempest-GroupsTest-375634634 None] Delete group completed successfully. Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:28 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:28 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:28 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.326s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:28 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1e71121e-4b80-4c76-a84b-b3b996731ba6 tempest-GroupsTest-375634634 None] Delete group completed successfully. Jul 20 16:41:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3d65f5a4-e89e-4f73-986a-745659bba8dd tempest-GroupsTest-375634634 None] Group tempest-GroupsTest-Group-95778085: creating Jul 20 16:41:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3d65f5a4-e89e-4f73-986a-745659bba8dd tempest-GroupsTest-375634634 None] Group tempest-GroupsTest-Group-95778085: created successfully Jul 20 16:41:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3d65f5a4-e89e-4f73-986a-745659bba8dd tempest-GroupsTest-375634634 None] Create group completed successfully. Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Flow 'volume_create_manager' (546b0739-0028-4eee-bc5b-1e9fd6986f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af37d89-9207-406c-942a-8f25ebc1cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af37d89-9207-406c-942a-8f25ebc1cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2097438918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef89c51-70f8-4784-ad42-4745467dcda4,host='devstack@QuobyteHD#QuobyteHD',id=d7320fd4-7f4b-4113-947e-20e542d2e799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd3b9dbe1024ffa9b37b66d2d93a514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:32Z,use_quota=True,user_id='1bbc7272811d4ea48a9c8b88b813f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b2c2f5-ba3f-47dd-88e4-d8fc658ae100),volume_type_id=78b2c2f5-ba3f-47dd-88e4-d8fc658ae100)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a899acd4-118c-4cd6-a11b-0825ef58f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a899acd4-118c-4cd6-a11b-0825ef58f29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ea3062-e352-486f-bf93-54e3fe021d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ea3062-e352-486f-bf93-54e3fe021d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7320fd4-7f4b-4113-947e-20e542d2e799', 'volume_name': 'volume-d7320fd4-7f4b-4113-947e-20e542d2e799', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700ccd88-4639-4f38-ab70-0b8d84101dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700ccd88-4639-4f38-ab70-0b8d84101dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc16b108-5d1c-494b-8da7-45a14c4c3fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:32 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Volume d7320fd4-7f4b-4113-947e-20e542d2e799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7320fd4-7f4b-4113-947e-20e542d2e799', 'volume_size': 1} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ef89c51-70f8-4784-ad42-4745467dcda4,created_at=2026-07-20T14:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2097438918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef89c51-70f8-4784-ad42-4745467dcda4,host='devstack@QuobyteHD#QuobyteHD',id=d7320fd4-7f4b-4113-947e-20e542d2e799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd3b9dbe1024ffa9b37b66d2d93a514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:32Z,use_quota=True,user_id='1bbc7272811d4ea48a9c8b88b813f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b2c2f5-ba3f-47dd-88e4-d8fc658ae100),volume_type_id=78b2c2f5-ba3f-47dd-88e4-d8fc658ae100)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Creating volume d7320fd4-7f4b-4113-947e-20e542d2e799 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:41:32 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:32 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 1073741824 Jul 20 16:41:32 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:32 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 1073741824" returned: 0 in 0.755s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:32 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 Jul 20 16:41:32 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:33 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799" returned: 0 in 0.477s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc16b108-5d1c-494b-8da7-45a14c4c3fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7320fd4-7f4b-4113-947e-20e542d2e799', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562290d9-847e-4369-805c-af175d33265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:33 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Volume volume-d7320fd4-7f4b-4113-947e-20e542d2e799 (d7320fd4-7f4b-4113-947e-20e542d2e799): created successfully Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562290d9-847e-4369-805c-af175d33265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Flow 'volume_create_manager' (546b0739-0028-4eee-bc5b-1e9fd6986f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1c713036-85c8-45ae-a38e-ca989153432c tempest-GroupsTest-375634634 None] Created volume successfully. Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Flow 'volume_create_manager' (59062643-ba9c-4a03-a209-5585a33bb22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8535c9b-cd3b-4162-ab43-c783b5ccd2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8535c9b-cd3b-4162-ab43-c783b5ccd2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515024766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef89c51-70f8-4784-ad42-4745467dcda4,host='devstack@QuobyteHD#QuobyteHD',id=dae2e226-650d-43c9-a4ab-83ff527d9f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd3b9dbe1024ffa9b37b66d2d93a514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:36Z,use_quota=True,user_id='1bbc7272811d4ea48a9c8b88b813f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b2c2f5-ba3f-47dd-88e4-d8fc658ae100),volume_type_id=78b2c2f5-ba3f-47dd-88e4-d8fc658ae100)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbff73d-b192-4a2f-a074-d60bc873934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbff73d-b192-4a2f-a074-d60bc873934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85be9561-d2dd-4fa9-b530-95414ad68d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85be9561-d2dd-4fa9-b530-95414ad68d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae2e226-650d-43c9-a4ab-83ff527d9f4b', 'volume_name': 'volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84182f89-0513-47bb-85a0-dd177647fe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84182f89-0513-47bb-85a0-dd177647fe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b509aa-e960-4832-b0ed-3247ba723934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:35 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Volume dae2e226-650d-43c9-a4ab-83ff527d9f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b', 'volume_size': 1} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ef89c51-70f8-4784-ad42-4745467dcda4,created_at=2026-07-20T14:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515024766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ef89c51-70f8-4784-ad42-4745467dcda4,host='devstack@QuobyteHD#QuobyteHD',id=dae2e226-650d-43c9-a4ab-83ff527d9f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dd3b9dbe1024ffa9b37b66d2d93a514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:41:36Z,use_quota=True,user_id='1bbc7272811d4ea48a9c8b88b813f707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b2c2f5-ba3f-47dd-88e4-d8fc658ae100),volume_type_id=78b2c2f5-ba3f-47dd-88e4-d8fc658ae100)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Creating volume dae2e226-650d-43c9-a4ab-83ff527d9f4b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:41:35 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:41:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:36 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b 1073741824 Jul 20 16:41:36 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:36 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b 1073741824" returned: 0 in 0.697s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:36 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b Jul 20 16:41:36 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:37 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b" returned: 0 in 0.476s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b509aa-e960-4832-b0ed-3247ba723934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccf3552-3275-4552-81b4-cc6989ba4fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:41:37 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Volume volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b (dae2e226-650d-43c9-a4ab-83ff527d9f4b): created successfully Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccf3552-3275-4552-81b4-cc6989ba4fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:41:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Flow 'volume_create_manager' (59062643-ba9c-4a03-a209-5585a33bb22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:41:37 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c13bbd04-048a-4724-b28c-3c621a8d076e tempest-GroupsTest-375634634 None] Created volume successfully. Jul 20 16:41:38 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-316c13bd-fdc9-4347-bd69-cb473493eccc tempest-GroupsTest-375634634 None] Update group completed successfully. Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:39 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:39 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:39 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 8 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:41:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:41:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ece73cf5-0e56-4c6e-ad33-732db56d8dc3 tempest-GroupsTest-375634634 None] Update group completed successfully. Jul 20 16:41:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Acquiring lock "cinder-quobyte-d7320fd4-7f4b-4113-947e-20e542d2e799" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Lock "cinder-quobyte-d7320fd4-7f4b-4113-947e-20e542d2e799" acquired by "delete_volume" :: waited 0.056s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:42 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d22cc-b62f-439a-a2a6-acb0c027a790]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:42 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 Jul 20 16:41:42 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:43 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799" returned: 0 in 0.666s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:43 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799 Jul 20 16:41:43 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:43 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d7320fd4-7f4b-4113-947e-20e542d2e799" returned: 0 in 0.417s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Lock "cinder-quobyte-d7320fd4-7f4b-4113-947e-20e542d2e799" released by "delete_volume" :: held 1.206s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Acquiring lock "cinder-quobyte-dae2e226-650d-43c9-a4ab-83ff527d9f4b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Lock "cinder-quobyte-dae2e226-650d-43c9-a4ab-83ff527d9f4b" acquired by "delete_volume" :: waited 0.058s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701df8d-bb66-4d24-92e2-434d58d81dcf]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:41:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:44 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b Jul 20 16:41:44 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:44 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b" returned: 0 in 0.799s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:44 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b Jul 20 16:41:44 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:45 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dae2e226-650d-43c9-a4ab-83ff527d9f4b" returned: 0 in 0.563s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Lock "cinder-quobyte-dae2e226-650d-43c9-a4ab-83ff527d9f4b" released by "delete_volume" :: held 1.495s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Created reservations ['46cf152f-4ce0-425c-84cb-dd6e72b6b329'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:45 devstack cinder-volume[87535]: WARNING cinder.quota [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-283162332 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-283162332, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:41:45 devstack cinder-volume[87535]: WARNING cinder.quota [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-283162332 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-283162332, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Created reservations ['3a8829dc-b1f9-4932-97c6-a353bc3c80fc', 'da711f3e-a01c-4836-8a48-767b796a2e6f', '2afc8df5-aa3d-4c56-a8bd-c370e6fb8427', '1344d2a1-2836-481c-a525-6cb12a19b9a8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Created reservations ['01ecf231-0a15-4fcb-8f16-3679ff967666', 'ee0206bb-fe12-4a3e-bb08-be77c677a103', '36397798-5677-4c2b-8726-09df306fee25', '4a092e46-091b-40ed-a666-5aaa2a93c6b0'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:41:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:41:45 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:41:45 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:41:46 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Jul 20 16:41:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:41:46 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:41:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-16818e37-00a6-41c1-b1b0-283dc0505a47 tempest-GroupsTest-375634634 None] Delete group completed successfully. Jul 20 16:41:47 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=78,cinder:UPDATE=105,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:41:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=94,cinder:INSERT=28,cinder:UPDATE=92,cinder:DELETE=8 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Flow 'volume_create_manager' (095d3690-c1fa-4f5d-b6a9-a34dad01256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c7187c-4726-4fe6-a54f-a46b95a4b448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c7187c-4726-4fe6-a54f-a46b95a4b448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-380376674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b3d80c4aa24b0fb57d538950b47c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:01Z,use_quota=True,user_id='4be4116e0cc144168d731f32885920c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03e721a-0163-46f8-9745-496c1f1758d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03e721a-0163-46f8-9745-496c1f1758d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d86d266-7d00-4d23-9498-ee372630b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d86d266-7d00-4d23-9498-ee372630b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4', 'volume_name': 'volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf82a7-822b-486e-a95a-33d5cea2b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf82a7-822b-486e-a95a-33d5cea2b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542cc57a-16ca-43a4-8795-3bd96dcb4de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Volume 8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4', 'volume_size': 1} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-380376674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b3d80c4aa24b0fb57d538950b47c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:01Z,use_quota=True,user_id='4be4116e0cc144168d731f32885920c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Creating volume 8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:01 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:01 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 1073741824 Jul 20 16:42:01 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:01 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 1073741824" returned: 0 in 0.549s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:01 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 Jul 20 16:42:01 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:02 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542cc57a-16ca-43a4-8795-3bd96dcb4de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85117aaf-eaa7-4aec-84fb-d587342bc756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Volume volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 (8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4): created successfully Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85117aaf-eaa7-4aec-84fb-d587342bc756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Flow 'volume_create_manager' (095d3690-c1fa-4f5d-b6a9-a34dad01256c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-22979256-6201-4b80-9fc7-463cd6fa8a01 tempest-TaggedAttachmentsTest-1593001207 None] Created volume successfully. Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Flow 'volume_create_manager' (f0d52607-3ad7-4f43-bcf2-4e9c87b6475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dcd080-8273-4377-aa82-e4f6d7e8f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45dcd080-8273-4377-aa82-e4f6d7e8f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-941746171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7152e95-a756-4c26-ae33-ed2e7eda0c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea71ecf48044b5980ed942667e66bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:03Z,use_quota=True,user_id='c03af9a51749404e9a80368d9ee64bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447cf886-9d1e-4aca-a6c4-824b5abf19aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447cf886-9d1e-4aca-a6c4-824b5abf19aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bac6e3-85b8-40da-a0b2-57d15d023c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bac6e3-85b8-40da-a0b2-57d15d023c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7152e95-a756-4c26-ae33-ed2e7eda0c8e', 'volume_name': 'volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad550124-2b4b-4172-b42c-90160a1d33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad550124-2b4b-4172-b42c-90160a1d33e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bad8a9d-0b52-40c5-b64c-8326328993eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:03 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Volume f7152e95-a756-4c26-ae33-ed2e7eda0c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e', 'volume_size': 1} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-941746171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7152e95-a756-4c26-ae33-ed2e7eda0c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea71ecf48044b5980ed942667e66bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:03Z,use_quota=True,user_id='c03af9a51749404e9a80368d9ee64bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Creating volume f7152e95-a756-4c26-ae33-ed2e7eda0c8e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:03 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:03 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e 1073741824 Jul 20 16:42:03 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:04 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e 1073741824" returned: 0 in 0.540s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:04 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e Jul 20 16:42:04 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:04 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bad8a9d-0b52-40c5-b64c-8326328993eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f10ed9c-0184-4a9e-b65b-cdf642932ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:04 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Volume volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e (f7152e95-a756-4c26-ae33-ed2e7eda0c8e): created successfully Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f10ed9c-0184-4a9e-b65b-cdf642932ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Flow 'volume_create_manager' (f0d52607-3ad7-4f43-bcf2-4e9c87b6475a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2cfeb2d1-79ee-459b-8510-dd9c817d0b3c tempest-AttachVolumeTestJSON-1010339889 None] Created volume successfully. Jul 20 16:42:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-53276268-678f-4128-98c0-8ec78ae6fc26 req-02adba9c-076d-4047-8134-76076f75b7ea tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-53276268-678f-4128-98c0-8ec78ae6fc26 req-02adba9c-076d-4047-8134-76076f75b7ea tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-53276268-678f-4128-98c0-8ec78ae6fc26 req-02adba9c-076d-4047-8134-76076f75b7ea tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-53276268-678f-4128-98c0-8ec78ae6fc26 req-02adba9c-076d-4047-8134-76076f75b7ea tempest-AttachVolumeTestJSON-1010339889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90a3deeb-a9bd-43f5-b47a-d539d8446129', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:42:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-53276268-678f-4128-98c0-8ec78ae6fc26 req-02adba9c-076d-4047-8134-76076f75b7ea tempest-AttachVolumeTestJSON-1010339889 None] attachment_update completed successfully. Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Flow 'volume_create_manager' (6c0e9823-bebe-409b-b0a0-8f821d188b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458a1ebe-78d1-47ac-809f-1ceca2295f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458a1ebe-78d1-47ac-809f-1ceca2295f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-856972651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270992d1-a42d-48df-a8e1-309dc0c86d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430f49ec0e0f4cce908ede59cb308ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:13Z,use_quota=True,user_id='72afa11dd2834ae4a96495ffe37276d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff2ae115-9a62-4a0e-b845-f54deb5d943d),volume_type_id=ff2ae115-9a62-4a0e-b845-f54deb5d943d)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9d7650-9af8-4cb0-957b-80f5c0a656ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9d7650-9af8-4cb0-957b-80f5c0a656ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04ee7ee-4f92-4d2c-8659-6868234582d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04ee7ee-4f92-4d2c-8659-6868234582d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270992d1-a42d-48df-a8e1-309dc0c86d8f', 'volume_name': 'volume-270992d1-a42d-48df-a8e1-309dc0c86d8f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65bbe3c-885f-4f69-bd8a-c7bf5f7974ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65bbe3c-885f-4f69-bd8a-c7bf5f7974ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9afdd5-4cab-4a50-addf-e4ae13f84cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Volume 270992d1-a42d-48df-a8e1-309dc0c86d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270992d1-a42d-48df-a8e1-309dc0c86d8f', 'volume_size': 1} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-856972651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270992d1-a42d-48df-a8e1-309dc0c86d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430f49ec0e0f4cce908ede59cb308ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:13Z,use_quota=True,user_id='72afa11dd2834ae4a96495ffe37276d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff2ae115-9a62-4a0e-b845-f54deb5d943d),volume_type_id=ff2ae115-9a62-4a0e-b845-f54deb5d943d)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Creating volume 270992d1-a42d-48df-a8e1-309dc0c86d8f {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:12 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:12 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f 1073741824 Jul 20 16:42:12 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:13 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f 1073741824" returned: 0 in 0.966s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:13 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f Jul 20 16:42:13 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:14 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f" returned: 0 in 0.496s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9afdd5-4cab-4a50-addf-e4ae13f84cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270992d1-a42d-48df-a8e1-309dc0c86d8f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51496578-4496-4667-bec8-30c441afe408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Volume volume-270992d1-a42d-48df-a8e1-309dc0c86d8f (270992d1-a42d-48df-a8e1-309dc0c86d8f): created successfully Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51496578-4496-4667-bec8-30c441afe408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Flow 'volume_create_manager' (6c0e9823-bebe-409b-b0a0-8f821d188b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3605dcdb-3031-4d21-be7e-a904c64823e8 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Created volume successfully. Jul 20 16:42:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:15 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:15 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:16 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.589s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:16 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7d11c9bf-815b-4677-92d9-bc56c1183a52 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Retype volume completed successfully. Jul 20 16:42:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Acquiring lock "cinder-270992d1-a42d-48df-a8e1-309dc0c86d8f-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "cinder-270992d1-a42d-48df-a8e1-309dc0c86d8f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Acquiring lock "cinder-quobyte-270992d1-a42d-48df-a8e1-309dc0c86d8f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "cinder-quobyte-270992d1-a42d-48df-a8e1-309dc0c86d8f" acquired by "delete_volume" :: waited 0.085s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7196954-2476-48f4-ab80-e6b317662b75]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:42:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:17 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f Jul 20 16:42:17 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:17 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f" returned: 0 in 0.701s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:17 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f Jul 20 16:42:17 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:18 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-270992d1-a42d-48df-a8e1-309dc0c86d8f" returned: 0 in 0.524s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "cinder-quobyte-270992d1-a42d-48df-a8e1-309dc0c86d8f" released by "delete_volume" :: held 1.332s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:18 devstack cinder-volume[87535]: WARNING cinder.quota [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:42:18 devstack cinder-volume[87535]: WARNING cinder.quota [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Created reservations ['f9100416-c39b-43b5-96cc-8c4267c8425d', '06f2001b-42df-4815-8849-808183d15aba', 'e2b51ee8-9349-4c57-b3ce-f6b0d6f99095', 'ab5ba1c8-7983-4eab-9cc2-3f25575f1f7a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:18 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:18 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:19 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Deleted volume successfully. Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a8f8855f-d71f-4908-8f0d-ca8f348d9861 tempest-VolumeRetypeWithoutMigrationTest-63678447 None] Lock "cinder-270992d1-a42d-48df-a8e1-309dc0c86d8f-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Flow 'volume_create_manager' (217cb0a7-45a6-4059-ab96-e998e9151ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a107576-fcf1-4452-8dc1-5863861d085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a107576-fcf1-4452-8dc1-5863861d085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-643021534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5710cba0-dc61-4707-9f5b-0658a54ee17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3305203a801d4f21a84978bd60cbb697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:19Z,use_quota=True,user_id='685ea7e7d12c44c8a912d2f2a6db9838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fef52c-1c86-4aa9-8b49-28321f5d7162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fef52c-1c86-4aa9-8b49-28321f5d7162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7fa8e-29d2-475a-a833-bb30a03e8a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7fa8e-29d2-475a-a833-bb30a03e8a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5710cba0-dc61-4707-9f5b-0658a54ee17a', 'volume_name': 'volume-5710cba0-dc61-4707-9f5b-0658a54ee17a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df77a1-b428-4f22-ab4a-ad226c2674c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30df77a1-b428-4f22-ab4a-ad226c2674c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43adf8d3-bdf5-42fe-a1dc-c7c13bfdd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:19 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Volume 5710cba0-dc61-4707-9f5b-0658a54ee17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5710cba0-dc61-4707-9f5b-0658a54ee17a', 'volume_size': 1} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-643021534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5710cba0-dc61-4707-9f5b-0658a54ee17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3305203a801d4f21a84978bd60cbb697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:19Z,use_quota=True,user_id='685ea7e7d12c44c8a912d2f2a6db9838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Creating volume 5710cba0-dc61-4707-9f5b-0658a54ee17a {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:19 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:19 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a 1073741824 Jul 20 16:42:19 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:20 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a 1073741824" returned: 0 in 0.733s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:20 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a Jul 20 16:42:20 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:20 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a" returned: 0 in 0.484s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43adf8d3-bdf5-42fe-a1dc-c7c13bfdd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5710cba0-dc61-4707-9f5b-0658a54ee17a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87b73a5-7f58-479b-bc70-3ba73acb8181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:20 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Volume volume-5710cba0-dc61-4707-9f5b-0658a54ee17a (5710cba0-dc61-4707-9f5b-0658a54ee17a): created successfully Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87b73a5-7f58-479b-bc70-3ba73acb8181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Flow 'volume_create_manager' (217cb0a7-45a6-4059-ab96-e998e9151ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-03fd6bcd-e6e4-42c0-a85b-3b80e83a21c7 tempest-ServerActionsTestOtherA-1063072476 None] Created volume successfully. Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Flow 'volume_create_manager' (7b2a93be-bf54-41c8-8dca-d50fc9fa2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5255161-7f73-4c00-9e99-828744900709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5255161-7f73-4c00-9e99-828744900709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401851948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c41b34a-2a68-4c98-9d26-0e57c788b4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0476a1bd938c47c190f345f735a134dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:29Z,use_quota=True,user_id='10f567bc92c34000acb8c0f512a02972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d647d9-d8fa-420a-873a-e793bb00af12),volume_type_id=15d647d9-d8fa-420a-873a-e793bb00af12)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd7d75b-73f0-41c9-bcbf-cad4646b6715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd7d75b-73f0-41c9-bcbf-cad4646b6715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabf4672-90b9-455f-a7ce-eab6017934e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabf4672-90b9-455f-a7ce-eab6017934e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c41b34a-2a68-4c98-9d26-0e57c788b4d4', 'volume_name': 'volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40c4357-d993-4127-b59f-119e5ce5c1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40c4357-d993-4127-b59f-119e5ce5c1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea16982-4633-4a6c-bd84-d6664d171f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Volume 9c41b34a-2a68-4c98-9d26-0e57c788b4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4', 'volume_size': 1} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401851948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c41b34a-2a68-4c98-9d26-0e57c788b4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0476a1bd938c47c190f345f735a134dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:29Z,use_quota=True,user_id='10f567bc92c34000acb8c0f512a02972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d647d9-d8fa-420a-873a-e793bb00af12),volume_type_id=15d647d9-d8fa-420a-873a-e793bb00af12)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Creating volume 9c41b34a-2a68-4c98-9d26-0e57c788b4d4 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:29 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:29 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 1073741824 Jul 20 16:42:29 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:30 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 1073741824" returned: 0 in 0.873s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:30 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 Jul 20 16:42:30 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:30 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea16982-4633-4a6c-bd84-d6664d171f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bc438f-03fd-40e5-9361-26c6a585d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Volume volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 (9c41b34a-2a68-4c98-9d26-0e57c788b4d4): created successfully Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bc438f-03fd-40e5-9361-26c6a585d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Flow 'volume_create_manager' (7b2a93be-bf54-41c8-8dca-d50fc9fa2a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-992ef274-945c-49d4-ab4a-ebed2611db5b tempest-VolumeTypesAccessTest-1113049197 None] Created volume successfully. Jul 20 16:42:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Acquiring lock "cinder-9c41b34a-2a68-4c98-9d26-0e57c788b4d4-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Lock "cinder-9c41b34a-2a68-4c98-9d26-0e57c788b4d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Acquiring lock "cinder-quobyte-9c41b34a-2a68-4c98-9d26-0e57c788b4d4" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Lock "cinder-quobyte-9c41b34a-2a68-4c98-9d26-0e57c788b4d4" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[38903d66-6584-4351-98bb-28dd42c8357c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:42:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:31 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 Jul 20 16:42:31 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:32 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4" returned: 0 in 0.425s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:32 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4 Jul 20 16:42:32 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:32 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9c41b34a-2a68-4c98-9d26-0e57c788b4d4" returned: 0 in 0.257s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Lock "cinder-quobyte-9c41b34a-2a68-4c98-9d26-0e57c788b4d4" released by "delete_volume" :: held 0.734s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:32 devstack cinder-volume[87535]: WARNING cinder.quota [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-900544923 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-900544923, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:42:32 devstack cinder-volume[87535]: WARNING cinder.quota [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-900544923 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-900544923, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Created reservations ['36f00606-a3ab-48fe-965f-7752c4157741', '81f40c8c-67a5-4f7d-a607-1507dea9749a', 'b13ec67e-c87a-4fd8-b085-8d66f42c3588', '1fb62ba8-a616-4921-98f8-4fa1c3e540b1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:32 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:32 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:32 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Deleted volume successfully. Jul 20 16:42:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4ebe3b7a-863f-4e5e-91db-9d4638705a91 tempest-VolumeTypesAccessTest-1113049197 None] Lock "cinder-9c41b34a-2a68-4c98-9d26-0e57c788b4d4-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:39 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:39 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:39 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:42 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=37,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:42:42 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=30,cinder:UPDATE=39,cinder:INSERT=3,cinder:DELETE=4 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:42:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-104d22bf-a3ba-4ecc-a55f-8efd7564e34a req-86357015-2c49-48f7-b5c7-58edbe197f24 tempest-TaggedAttachmentsTest-1593001207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-104d22bf-a3ba-4ecc-a55f-8efd7564e34a req-86357015-2c49-48f7-b5c7-58edbe197f24 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-104d22bf-a3ba-4ecc-a55f-8efd7564e34a req-86357015-2c49-48f7-b5c7-58edbe197f24 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-104d22bf-a3ba-4ecc-a55f-8efd7564e34a req-86357015-2c49-48f7-b5c7-58edbe197f24 tempest-TaggedAttachmentsTest-1593001207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1486ca3e-84f6-4b00-b3e3-5d81d7174909', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:42:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-104d22bf-a3ba-4ecc-a55f-8efd7564e34a req-86357015-2c49-48f7-b5c7-58edbe197f24 tempest-TaggedAttachmentsTest-1593001207 None] attachment_update completed successfully. Jul 20 16:42:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-4a6d2050-417c-41a7-8a4f-1fee21c2e2c7 req-d5158d48-cb6b-400c-9543-d985773fdb9c tempest-TaggedAttachmentsTest-1593001207 None] Terminate volume connection completed successfully. Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-4a6d2050-417c-41a7-8a4f-1fee21c2e2c7 req-d5158d48-cb6b-400c-9543-d985773fdb9c tempest-TaggedAttachmentsTest-1593001207 None] Deleting attachment 1486ca3e-84f6-4b00-b3e3-5d81d7174909. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Flow 'volume_create_manager' (30128a75-8b20-467b-bc7d-b86cbed8a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a6a096-8b4c-410d-9161-ca0ba9aaef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a6a096-8b4c-410d-9161-ca0ba9aaef6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-719738219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783b1381-da71-4d07-b950-adfa33bd5d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de49893a7f64d689c47ce223fc26bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:48Z,use_quota=True,user_id='75f860db57434940b43d5558a9a7d40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ebf40d-7ec5-4450-9ec6-42e0b674df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ebf40d-7ec5-4450-9ec6-42e0b674df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b01c67-f4e3-4e43-85e9-7d1fe38a2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b01c67-f4e3-4e43-85e9-7d1fe38a2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783b1381-da71-4d07-b950-adfa33bd5d24', 'volume_name': 'volume-783b1381-da71-4d07-b950-adfa33bd5d24', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d771ff72-9777-4fa4-94a8-655ac3306ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d771ff72-9777-4fa4-94a8-655ac3306ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b3c140-5184-4a14-9456-393a5a502085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:47 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Volume 783b1381-da71-4d07-b950-adfa33bd5d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783b1381-da71-4d07-b950-adfa33bd5d24', 'volume_size': 1} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-719738219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783b1381-da71-4d07-b950-adfa33bd5d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de49893a7f64d689c47ce223fc26bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:48Z,use_quota=True,user_id='75f860db57434940b43d5558a9a7d40e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Creating volume 783b1381-da71-4d07-b950-adfa33bd5d24 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:47 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:47 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 1073741824 Jul 20 16:42:47 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:48 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 1073741824" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:48 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 Jul 20 16:42:48 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:48 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b3c140-5184-4a14-9456-393a5a502085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783b1381-da71-4d07-b950-adfa33bd5d24', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9494826f-b5e3-482f-a8b4-fb9f3e099e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:48 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Volume volume-783b1381-da71-4d07-b950-adfa33bd5d24 (783b1381-da71-4d07-b950-adfa33bd5d24): created successfully Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9494826f-b5e3-482f-a8b4-fb9f3e099e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Flow 'volume_create_manager' (30128a75-8b20-467b-bc7d-b86cbed8a45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ee4d90be-096f-4c4d-aae6-f38d4246de43 tempest-AbsoluteLimitsTests-1889842520 None] Created volume successfully. Jul 20 16:42:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Acquiring lock "cinder-783b1381-da71-4d07-b950-adfa33bd5d24-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Lock "cinder-783b1381-da71-4d07-b950-adfa33bd5d24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Acquiring lock "cinder-quobyte-783b1381-da71-4d07-b950-adfa33bd5d24" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Lock "cinder-quobyte-783b1381-da71-4d07-b950-adfa33bd5d24" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a53d1c8-38b3-487f-a4de-e4469bd6b057]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:49 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 Jul 20 16:42:49 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:49 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24" returned: 0 in 0.421s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:49 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24 Jul 20 16:42:49 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:49 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-783b1381-da71-4d07-b950-adfa33bd5d24" returned: 0 in 0.357s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Lock "cinder-quobyte-783b1381-da71-4d07-b950-adfa33bd5d24" released by "delete_volume" :: held 0.834s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:49 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Created reservations ['3929a328-f6f1-41e2-9536-3870e0c67456', '1e0367e5-a807-41ae-86d3-198d97be40a6', '2295a4a6-1e3c-46cb-a7c8-ba8e65c1dd75', 'a75d60ba-c61b-4b18-a9b8-949576f8a57d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:50 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:50 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:50 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.313s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:50 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Deleted volume successfully. Jul 20 16:42:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b54a8b34-f3d9-47f5-bf5f-47fbbb3c8a82 tempest-AbsoluteLimitsTests-1889842520 None] Lock "cinder-783b1381-da71-4d07-b950-adfa33bd5d24-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:54 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:42:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Flow 'volume_create_manager' (1d17be63-d247-4a5c-baa3-b989827eb3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f86d01a-7eca-4f62-9588-f00bc43f62e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f86d01a-7eca-4f62-9588-f00bc43f62e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-229566242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa11a56-e8b6-490d-b2e6-75891765cf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d831fa261634338bacd47a3e014d395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:55Z,use_quota=True,user_id='847e8b4b8a374f1ead0936025c6897f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c3fba1-2bba-4b1d-9e11-ecc2ea7708cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c3fba1-2bba-4b1d-9e11-ecc2ea7708cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7c8b7c-07fc-4c68-98dd-902380788bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7c8b7c-07fc-4c68-98dd-902380788bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa11a56-e8b6-490d-b2e6-75891765cf7a', 'volume_name': 'volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cb5762-159e-4585-9a4f-bdcc0fc3bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cb5762-159e-4585-9a4f-bdcc0fc3bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67386f1d-51ef-4da5-b170-ff497f7fabcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:55 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Volume 9aa11a56-e8b6-490d-b2e6-75891765cf7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a', 'volume_size': 1} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-229566242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa11a56-e8b6-490d-b2e6-75891765cf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d831fa261634338bacd47a3e014d395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:42:55Z,use_quota=True,user_id='847e8b4b8a374f1ead0936025c6897f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Creating volume 9aa11a56-e8b6-490d-b2e6-75891765cf7a {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:42:55 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:55 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a 1073741824 Jul 20 16:42:55 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-1aeadc32-b3b4-4f10-88a7-35875fd0b8d6 req-516047a3-e809-483e-9112-211d2e8a09f3 tempest-AttachVolumeTestJSON-1010339889 None] Terminate volume connection completed successfully. Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-1aeadc32-b3b4-4f10-88a7-35875fd0b8d6 req-516047a3-e809-483e-9112-211d2e8a09f3 tempest-AttachVolumeTestJSON-1010339889 None] Deleting attachment 90a3deeb-a9bd-43f5-b47a-d539d8446129. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:42:55 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a 1073741824" returned: 0 in 0.612s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:55 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a Jul 20 16:42:55 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-3c40cf49-c23e-4549-93ff-6bd7732f5f93 req-f22af548-0fde-4cbb-a1ae-79cd94e42cb3 tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:56 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a" returned: 0 in 0.420s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-3c40cf49-c23e-4549-93ff-6bd7732f5f93 req-f22af548-0fde-4cbb-a1ae-79cd94e42cb3 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.040s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67386f1d-51ef-4da5-b170-ff497f7fabcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459f1d7-e7a6-47ab-b71d-2f20cea3648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-3c40cf49-c23e-4549-93ff-6bd7732f5f93 req-f22af548-0fde-4cbb-a1ae-79cd94e42cb3 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Volume volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a (9aa11a56-e8b6-490d-b2e6-75891765cf7a): created successfully Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459f1d7-e7a6-47ab-b71d-2f20cea3648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Flow 'volume_create_manager' (1d17be63-d247-4a5c-baa3-b989827eb3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:42:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-647d4cae-c3ab-4171-9ba4-44db81b7cc67 tempest-VolumesMetadataTest-727002924 None] Created volume successfully. Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-3c40cf49-c23e-4549-93ff-6bd7732f5f93 req-f22af548-0fde-4cbb-a1ae-79cd94e42cb3 tempest-ServerActionsTestOtherA-1063072476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-5710cba0-dc61-4707-9f5b-0658a54ee17a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e94dc4fd-d341-4072-a6bf-d1b81451d975', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:42:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-3c40cf49-c23e-4549-93ff-6bd7732f5f93 req-f22af548-0fde-4cbb-a1ae-79cd94e42cb3 tempest-ServerActionsTestOtherA-1063072476 None] attachment_update completed successfully. Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Acquiring lock "cinder-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Lock "cinder-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Acquiring lock "cinder-quobyte-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Lock "cinder-quobyte-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231b0a9-4edc-45a3-aad0-72529b6dd34c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:57 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 Jul 20 16:42:57 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:57 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4" returned: 0 in 0.444s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:57 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4 Jul 20 16:42:57 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:57 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4" returned: 0 in 0.294s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Lock "cinder-quobyte-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4" released by "delete_volume" :: held 0.809s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Created reservations ['0cb9eec6-7003-4084-9e9e-d90cfc2f7100', '3fa46d54-8f80-4258-af05-94a8a0bbeec3', 'fd45ead8-b97e-437d-b939-299a1a8e8cc2', '81ed3a18-2234-4b84-acb9-9fbb6b27f11f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Acquiring lock "cinder-9aa11a56-e8b6-490d-b2e6-75891765cf7a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Lock "cinder-9aa11a56-e8b6-490d-b2e6-75891765cf7a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Acquiring lock "cinder-quobyte-9aa11a56-e8b6-490d-b2e6-75891765cf7a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:42:58 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:58 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Lock "cinder-quobyte-9aa11a56-e8b6-490d-b2e6-75891765cf7a" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf5fa84-68b7-4988-8ad6-b26c6d6184df]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:58 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a Jul 20 16:42:58 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:58 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.295s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:58 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Deleted volume successfully. Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8fea77b1-f666-4d63-a466-09d0243c0798 tempest-TaggedAttachmentsTest-1593001207 None] Lock "cinder-8d8f6e47-22d6-4e69-81f9-f8bd7ebbeda4-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:58 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:58 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a Jul 20 16:42:58 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9aa11a56-e8b6-490d-b2e6-75891765cf7a" returned: 0 in 0.525s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:59 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Lock "cinder-quobyte-9aa11a56-e8b6-490d-b2e6-75891765cf7a" released by "delete_volume" :: held 1.060s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Created reservations ['bb0964c9-bfc8-4fd8-8274-840a723a27c5', '0108b1ae-cc7c-4368-ae0d-e8b911913f7e', 'fd074edd-3198-4de5-87f3-e042fbdf83ab', 'cb40d0ba-98ea-4705-a06b-16e6173cc2e1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:42:59 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:42:59 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:42:59 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.322s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:42:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Deleted volume successfully. Jul 20 16:42:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bed45d52-ae9c-4725-9544-fce47a8dd3a3 tempest-VolumesMetadataTest-727002924 None] Lock "cinder-9aa11a56-e8b6-490d-b2e6-75891765cf7a-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-db641199-ccb8-4127-b2fb-02889b23d431 req-4a881b15-dc43-420b-adb5-43d970691d08 tempest-ServerActionsTestOtherA-1063072476 None] Terminate volume connection completed successfully. Jul 20 16:43:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-db641199-ccb8-4127-b2fb-02889b23d431 req-4a881b15-dc43-420b-adb5-43d970691d08 tempest-ServerActionsTestOtherA-1063072476 None] Deleting attachment e94dc4fd-d341-4072-a6bf-d1b81451d975. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:43:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-db641199-ccb8-4127-b2fb-02889b23d431 req-595081cb-f58e-4137-b25c-3efa2021ee9a tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-db641199-ccb8-4127-b2fb-02889b23d431 req-595081cb-f58e-4137-b25c-3efa2021ee9a tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-db641199-ccb8-4127-b2fb-02889b23d431 req-595081cb-f58e-4137-b25c-3efa2021ee9a tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-db641199-ccb8-4127-b2fb-02889b23d431 req-595081cb-f58e-4137-b25c-3efa2021ee9a tempest-ServerActionsTestOtherA-1063072476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-5710cba0-dc61-4707-9f5b-0658a54ee17a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b7e4a35-7686-41e5-acb4-a64775059c28', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:43:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-db641199-ccb8-4127-b2fb-02889b23d431 req-595081cb-f58e-4137-b25c-3efa2021ee9a tempest-ServerActionsTestOtherA-1063072476 None] attachment_update completed successfully. Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Flow 'volume_create_manager' (b512475a-5954-45b6-b4af-3dfa31eb0df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c527a6-611e-4081-b8d7-ff0a7e89e600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c527a6-611e-4081-b8d7-ff0a7e89e600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1469070849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454d104e-e08b-4551-8bbc-bf3665035d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e09e627ac294728b68db6b02ae6704b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:10Z,use_quota=True,user_id='e8de14c9c47247b09b417a39a9ea4d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f3a2d-b93f-4af8-b7a3-bcc8304f0dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f3a2d-b93f-4af8-b7a3-bcc8304f0dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eadd82-bef1-4b89-a6d3-df78724a6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40eadd82-bef1-4b89-a6d3-df78724a6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454d104e-e08b-4551-8bbc-bf3665035d32', 'volume_name': 'volume-454d104e-e08b-4551-8bbc-bf3665035d32', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cf45f0-252f-4228-8d0e-579f1b25b781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cf45f0-252f-4228-8d0e-579f1b25b781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c08db76-6778-43f3-afea-2d39fc0cda73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:10 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Volume 454d104e-e08b-4551-8bbc-bf3665035d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454d104e-e08b-4551-8bbc-bf3665035d32', 'volume_size': 1} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1469070849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454d104e-e08b-4551-8bbc-bf3665035d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e09e627ac294728b68db6b02ae6704b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:10Z,use_quota=True,user_id='e8de14c9c47247b09b417a39a9ea4d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Creating volume 454d104e-e08b-4551-8bbc-bf3665035d32 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:43:10 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:43:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:10 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 1073741824 Jul 20 16:43:10 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:11 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 1073741824" returned: 0 in 0.688s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:11 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 Jul 20 16:43:11 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:11 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32" returned: 0 in 0.452s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c08db76-6778-43f3-afea-2d39fc0cda73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454d104e-e08b-4551-8bbc-bf3665035d32', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd7ae8f-a6b7-43e4-94d9-2e7d51d0e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:11 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Volume volume-454d104e-e08b-4551-8bbc-bf3665035d32 (454d104e-e08b-4551-8bbc-bf3665035d32): created successfully Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd7ae8f-a6b7-43e4-94d9-2e7d51d0e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Flow 'volume_create_manager' (b512475a-5954-45b6-b4af-3dfa31eb0df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d8267d25-68dd-4799-b98b-44caf99f0a19 tempest-VolumesTransfersTest-1750619473 None] Created volume successfully. Jul 20 16:43:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3c8216fd-4e33-4b82-a9f3-02387a9db5d3 tempest-VolumesTransfersTest-1903344474 None] Transfer volume completed successfully. Jul 20 16:43:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Acquiring lock "cinder-454d104e-e08b-4551-8bbc-bf3665035d32-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-454d104e-e08b-4551-8bbc-bf3665035d32-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Acquiring lock "cinder-quobyte-454d104e-e08b-4551-8bbc-bf3665035d32" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-quobyte-454d104e-e08b-4551-8bbc-bf3665035d32" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aaf167-18cb-4739-ba57-ec390d6bb129]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:14 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 Jul 20 16:43:14 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:14 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32" returned: 0 in 0.456s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:14 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32 Jul 20 16:43:14 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:14 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-454d104e-e08b-4551-8bbc-bf3665035d32" returned: 0 in 0.283s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-quobyte-454d104e-e08b-4551-8bbc-bf3665035d32" released by "delete_volume" :: held 0.824s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Created reservations ['a56efe76-a026-44f1-b9e3-22aca05d10b2', 'e4a3af5d-fba4-43ce-a6f6-63325c1fe0b1', '1e78a4a0-7bf9-4506-935f-e81f9e11935f', '81200d7a-498d-4bca-a479-38820c7cf3d9'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:15 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:43:15 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:15 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.453s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:43:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Deleted volume successfully. Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b7581109-1ed4-41f2-ad61-258078689ee9 tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-454d104e-e08b-4551-8bbc-bf3665035d32-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Flow 'volume_create_manager' (8aa946aa-d977-4098-ab67-b031435d853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cafa697-2cd0-4917-8665-0cb8595691c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cafa697-2cd0-4917-8665-0cb8595691c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-812561040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfca5bc6-413c-4b2b-99c5-3baeabc81ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e09e627ac294728b68db6b02ae6704b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:16Z,use_quota=True,user_id='e8de14c9c47247b09b417a39a9ea4d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0e2661-9bc5-4dc3-8dab-2b2555ca68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0e2661-9bc5-4dc3-8dab-2b2555ca68c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d8f58f-3d90-40ed-88ea-88e5b3c2c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d8f58f-3d90-40ed-88ea-88e5b3c2c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfca5bc6-413c-4b2b-99c5-3baeabc81ee3', 'volume_name': 'volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6b77b9-0886-465a-9107-072e7d8e52ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6b77b9-0886-465a-9107-072e7d8e52ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1c8c35-18ff-442b-939a-293e4ee1867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Volume cfca5bc6-413c-4b2b-99c5-3baeabc81ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3', 'volume_size': 1} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-812561040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfca5bc6-413c-4b2b-99c5-3baeabc81ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e09e627ac294728b68db6b02ae6704b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:16Z,use_quota=True,user_id='e8de14c9c47247b09b417a39a9ea4d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Creating volume cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:43:16 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:16 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 1073741824 Jul 20 16:43:16 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:16 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 1073741824" returned: 0 in 0.498s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:16 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 Jul 20 16:43:16 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:16 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1c8c35-18ff-442b-939a-293e4ee1867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8aefaa-4f9d-4aa1-8d8d-0720912f21aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Volume volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 (cfca5bc6-413c-4b2b-99c5-3baeabc81ee3): created successfully Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8aefaa-4f9d-4aa1-8d8d-0720912f21aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Flow 'volume_create_manager' (8aa946aa-d977-4098-ab67-b031435d853d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-da66e5e7-19b6-45dc-b197-fdc0033380a6 tempest-VolumesTransfersTest-1750619473 None] Created volume successfully. Jul 20 16:43:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Acquiring lock "cinder-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Acquiring lock "cinder-quobyte-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-quobyte-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5178ac-d9f0-4885-8e4a-af135755a8ca]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:43:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:18 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 Jul 20 16:43:18 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:19 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3" returned: 0 in 0.550s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:19 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3 Jul 20 16:43:19 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:19 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-quobyte-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3" released by "delete_volume" :: held 0.900s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Created reservations ['f0a246b9-20b4-4047-b1dd-ac5145fe6abd', 'fb17d8b9-5f23-499c-be80-b0f40c3e9030', '09cc499c-9988-422f-bd1f-2fb52079da68', '1f968e89-1b40-42e6-af29-8f9bf182d1c3'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:19 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:43:19 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:19 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:43:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Deleted volume successfully. Jul 20 16:43:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2980ca57-c3cd-468a-b019-6d98f8797e0c tempest-VolumesTransfersTest-2047784681 None] Lock "cinder-cfca5bc6-413c-4b2b-99c5-3baeabc81ee3-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Flow 'volume_create_manager' (6aa70427-714b-472d-8b68-32d4aace7b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23ef47a-d5ae-49aa-931b-0e06cac04178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23ef47a-d5ae-49aa-931b-0e06cac04178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-544001859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4617de3-cd81-4b5e-9ea3-1bf715d9568d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf299d60196042d4920f4f31fd58bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:28Z,use_quota=True,user_id='4da23b8dbc3b4c81854a6703624172c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2457f0f-e036-47b6-a9cd-17ae7243b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2457f0f-e036-47b6-a9cd-17ae7243b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b9dec0-d349-4226-903d-2381d21de7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b9dec0-d349-4226-903d-2381d21de7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4617de3-cd81-4b5e-9ea3-1bf715d9568d', 'volume_name': 'volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7656dae-4f56-463e-8ab8-2a4c6a564663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7656dae-4f56-463e-8ab8-2a4c6a564663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bc4723-d444-4126-bc0a-6811f52c1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Volume c4617de3-cd81-4b5e-9ea3-1bf715d9568d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d', 'volume_size': 1} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-544001859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4617de3-cd81-4b5e-9ea3-1bf715d9568d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf299d60196042d4920f4f31fd58bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:28Z,use_quota=True,user_id='4da23b8dbc3b4c81854a6703624172c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Creating volume c4617de3-cd81-4b5e-9ea3-1bf715d9568d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:43:28 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:43:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:28 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d 1073741824 Jul 20 16:43:28 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:29 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d 1073741824" returned: 0 in 0.594s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:29 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d Jul 20 16:43:29 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:29 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d" returned: 0 in 0.486s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bc4723-d444-4126-bc0a-6811f52c1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850ed6ed-780f-4407-8d4e-4ab001760d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Volume volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d (c4617de3-cd81-4b5e-9ea3-1bf715d9568d): created successfully Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850ed6ed-780f-4407-8d4e-4ab001760d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Flow 'volume_create_manager' (6aa70427-714b-472d-8b68-32d4aace7b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5574304b-7e0e-461f-8f61-d158256eb2f9 tempest-VolumesTransfersV355Test-337441712 None] Created volume successfully. Jul 20 16:43:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a9fccf08-3a3b-45d7-8262-5e6b43b717bd tempest-VolumesTransfersV355Test-51604445 None] Transfer volume completed successfully. Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Acquiring lock "cinder-c4617de3-cd81-4b5e-9ea3-1bf715d9568d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-c4617de3-cd81-4b5e-9ea3-1bf715d9568d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Acquiring lock "cinder-quobyte-c4617de3-cd81-4b5e-9ea3-1bf715d9568d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-quobyte-c4617de3-cd81-4b5e-9ea3-1bf715d9568d" acquired by "delete_volume" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a750ea-fa48-408c-b940-8bca12d96f78]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-3efa0e90-bcdd-462c-9a8e-52038e31db02 req-30e1438a-520f-468c-aa12-69908742a375 tempest-ServerActionsTestOtherA-1063072476 None] Terminate volume connection completed successfully. Jul 20 16:43:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-3efa0e90-bcdd-462c-9a8e-52038e31db02 req-30e1438a-520f-468c-aa12-69908742a375 tempest-ServerActionsTestOtherA-1063072476 None] Deleting attachment 2b7e4a35-7686-41e5-acb4-a64775059c28. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:43:32 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d Jul 20 16:43:32 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:33 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d" returned: 0 in 0.544s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:33 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d Jul 20 16:43:33 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:33 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4617de3-cd81-4b5e-9ea3-1bf715d9568d" returned: 0 in 0.368s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-quobyte-c4617de3-cd81-4b5e-9ea3-1bf715d9568d" released by "delete_volume" :: held 1.007s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Created reservations ['a42896cc-65fd-4eca-b80a-4c60f5955883', 'eea054c9-4402-4ad7-8b88-10412c307c9a', '09bac535-31de-4ae5-9f0a-b16726c00429', 'c985ba9b-287a-4e56-bb75-14be99393664'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:33 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:43:33 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:34 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.439s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:34 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:43:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Deleted volume successfully. Jul 20 16:43:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1041ad99-ea8a-48e0-8059-1e0cd89244e5 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-c4617de3-cd81-4b5e-9ea3-1bf715d9568d-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Flow 'volume_create_manager' (137dfee1-3cc7-4790-a3f4-0caf5463a574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3792ab36-e96e-418f-a800-5c83aa4fcdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3792ab36-e96e-418f-a800-5c83aa4fcdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843320525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7e4fdf-0083-458d-872f-335ef88bdadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf299d60196042d4920f4f31fd58bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:36Z,use_quota=True,user_id='4da23b8dbc3b4c81854a6703624172c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5893cadd-e19e-403b-bdf1-a8ad7db6c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5893cadd-e19e-403b-bdf1-a8ad7db6c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3ecb89-fd4a-462e-8fe1-4605d2cbf487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3ecb89-fd4a-462e-8fe1-4605d2cbf487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7e4fdf-0083-458d-872f-335ef88bdadc', 'volume_name': 'volume-3b7e4fdf-0083-458d-872f-335ef88bdadc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab6ebd1-6b9e-485b-bd81-94ebd0fd42cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab6ebd1-6b9e-485b-bd81-94ebd0fd42cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247ea8e6-3536-4d5e-8239-4eb2e03ff88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:35 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Volume 3b7e4fdf-0083-458d-872f-335ef88bdadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7e4fdf-0083-458d-872f-335ef88bdadc', 'volume_size': 1} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843320525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7e4fdf-0083-458d-872f-335ef88bdadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf299d60196042d4920f4f31fd58bd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:36Z,use_quota=True,user_id='4da23b8dbc3b4c81854a6703624172c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Creating volume 3b7e4fdf-0083-458d-872f-335ef88bdadc {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:43:35 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:43:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:35 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc 1073741824 Jul 20 16:43:35 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:36 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc 1073741824" returned: 0 in 0.729s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:36 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc Jul 20 16:43:36 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:36 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc" returned: 0 in 0.422s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247ea8e6-3536-4d5e-8239-4eb2e03ff88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7e4fdf-0083-458d-872f-335ef88bdadc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059ef48e-4503-45c4-976a-aed80254f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:36 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Volume volume-3b7e4fdf-0083-458d-872f-335ef88bdadc (3b7e4fdf-0083-458d-872f-335ef88bdadc): created successfully Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059ef48e-4503-45c4-976a-aed80254f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Flow 'volume_create_manager' (137dfee1-3cc7-4790-a3f4-0caf5463a574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c88fae97-10f9-4b64-aab4-b421c2d1b576 tempest-VolumesTransfersV355Test-337441712 None] Created volume successfully. Jul 20 16:43:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Acquiring lock "cinder-3b7e4fdf-0083-458d-872f-335ef88bdadc-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-3b7e4fdf-0083-458d-872f-335ef88bdadc-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Acquiring lock "cinder-quobyte-3b7e4fdf-0083-458d-872f-335ef88bdadc" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-quobyte-3b7e4fdf-0083-458d-872f-335ef88bdadc" acquired by "delete_volume" :: waited 0.035s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:38 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[385431be-e941-49f1-854b-605b5c0ce7e3]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:43:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:38 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc Jul 20 16:43:38 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:39 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc" returned: 0 in 0.866s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:39 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:43:39 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:39 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc Jul 20 16:43:39 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:39 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3b7e4fdf-0083-458d-872f-335ef88bdadc" returned: 0 in 0.611s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-quobyte-3b7e4fdf-0083-458d-872f-335ef88bdadc" released by "delete_volume" :: held 1.586s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:39 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.779s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 8 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:43:39 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Created reservations ['4544379b-0731-4f64-8d2a-6bb4ddaac88b', '865bfa5b-52e9-4a33-a1b4-c4f603000143', '6a984640-ca53-44a0-9497-2d3e50afe29c', '9c2707da-8d76-492b-b6c6-2a06a05bb7f3'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:40 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:43:40 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:40 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.500s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:43:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Deleted volume successfully. Jul 20 16:43:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-54c30658-ca6c-4f7b-a62e-dfb09e80b1b8 tempest-VolumesTransfersV355Test-1007611677 None] Lock "cinder-3b7e4fdf-0083-458d-872f-335ef88bdadc-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "cinder-5710cba0-dc61-4707-9f5b-0658a54ee17a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Lock "cinder-5710cba0-dc61-4707-9f5b-0658a54ee17a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "cinder-quobyte-5710cba0-dc61-4707-9f5b-0658a54ee17a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:43:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Lock "cinder-quobyte-5710cba0-dc61-4707-9f5b-0658a54ee17a" acquired by "delete_volume" :: waited 0.073s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:43:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8376bb30-cd76-4bed-9975-0399c20c1947]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:43:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:42 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a Jul 20 16:43:42 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:42 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a" returned: 0 in 0.952s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:43 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a Jul 20 16:43:43 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:43 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5710cba0-dc61-4707-9f5b-0658a54ee17a" returned: 0 in 0.817s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Lock "cinder-quobyte-5710cba0-dc61-4707-9f5b-0658a54ee17a" released by "delete_volume" :: held 1.897s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:43 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=67,cinder:UPDATE=75,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:43:43 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=80,cinder:UPDATE=83,cinder:DELETE=5,cinder:INSERT=11 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:43:43 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Created reservations ['4912fcdf-2aa0-45ae-857f-4894c04f234f', '77dc1b2f-15af-4d70-9043-15156cd40d33', 'e809928b-8167-49a7-bc3a-f9620fc93780', '95844c2b-037c-4fe0-8a88-986bfac117fe'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:43:44 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:43:44 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:43:44 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.507s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:43:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Deleted volume successfully. Jul 20 16:43:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63af7f92-348b-4e23-aad2-4a87fa012234 tempest-ServerActionsTestOtherA-1063072476 None] Lock "cinder-5710cba0-dc61-4707-9f5b-0658a54ee17a-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:43:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:43:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Flow 'volume_create_manager' (ca086cef-9b4d-4751-960f-1416885fd181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9fa5dd-495e-4b75-9ca9-79754f23513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9fa5dd-495e-4b75-9ca9-79754f23513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-105987659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af72e7895344d01a886a022dd17c785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:58Z,use_quota=True,user_id='72944c07010f4173b95a093ac4198aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c75ab2-ae3b-4c5a-b31a-50bd52be7783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c75ab2-ae3b-4c5a-b31a-50bd52be7783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3c196a-ab83-45c5-981c-046f7a681b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:58 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:43:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3c196a-ab83-45c5-981c-046f7a681b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7', 'volume_name': 'volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4aec72-46f1-4133-8a83-0df35f867365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4aec72-46f1-4133-8a83-0df35f867365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:43:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d86893b-75e9-4fb0-964b-9f39ec034462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:43:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Volume 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 20 16:43:59 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Trying to clone 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 from image aa995944-e655-43b4-81e9-d04027d5b275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:43:59 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:43:59 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Image download 20.69 MB at 20.69 MB/s Jul 20 16:44:00 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[057860b1-1194-41bd-83ef-694e936d3320]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:00 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD Jul 20 16:44:00 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:00 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:00 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 is fetched for user 72944c07010f4173b95a093ac4198aa3. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:44:00 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Flow 'volume_create_manager' (f0d71c91-a711-4299-be0d-32234d3a8192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13495266-1dda-416f-90ce-02551f87ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13495266-1dda-416f-90ce-02551f87ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1218247118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c8909beb824df68427acbdae0386cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:01Z,use_quota=True,user_id='8539ac94f8874b1f9a7c1b1d29548160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5268f4c4-066b-4189-b1e4-131cc5aa733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5268f4c4-066b-4189-b1e4-131cc5aa733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df7d83c-2ea0-498f-a3e5-01e6fd40ca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df7d83c-2ea0-498f-a3e5-01e6fd40ca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a', 'volume_name': 'volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4af7ca-bf76-4f9b-b7a0-261a16a7dce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4af7ca-bf76-4f9b-b7a0-261a16a7dce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fe67a4-b110-49d4-a443-6b7fd7e49b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Volume 4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a', 'volume_size': 1} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1218247118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c8909beb824df68427acbdae0386cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:01Z,use_quota=True,user_id='8539ac94f8874b1f9a7c1b1d29548160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Creating volume 4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:44:01 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:01 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a 1073741824 Jul 20 16:44:01 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3ea75-d063-458d-9854-6a7fd6fb03fa]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:01 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD Jul 20 16:44:01 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:01 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:02 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a 1073741824" returned: 0 in 0.870s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:02 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a Jul 20 16:44:02 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:02 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a" returned: 0 in 0.489s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-105987659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af72e7895344d01a886a022dd17c785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:43:58Z,use_quota=True,user_id='72944c07010f4173b95a093ac4198aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Creating volume 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:44:02 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:02 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 1073741824 Jul 20 16:44:02 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fe67a4-b110-49d4-a443-6b7fd7e49b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7529ff54-b9eb-4548-b8ee-ff915eaaace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Volume volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a (4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a): created successfully Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7529ff54-b9eb-4548-b8ee-ff915eaaace9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Flow 'volume_create_manager' (f0d71c91-a711-4299-be0d-32234d3a8192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b6842d5b-5643-48d6-837d-7a4d5af59c95 tempest-ServerRescueNegativeTestJSON-1417844497 None] Created volume successfully. Jul 20 16:44:03 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 1073741824" returned: 0 in 1.035s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:03 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 Jul 20 16:44:03 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:04 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" returned: 0 in 0.407s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:44:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:04 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Attempting download of aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:44:04 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b47f16c-df08-4dd3-8b1c-4771efd8feac]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:04 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg Jul 20 16:44:04 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:05 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg" returned: 0 in 0.706s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:05 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg Jul 20 16:44:05 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:05 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg" returned: 1 in 0.623s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_h52e1edg' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:44:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[15481096-8169-4a6f-804f-d4a02d36f10c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:06 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD Jul 20 16:44:06 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:06 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:06 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] aa995944-e655-43b4-81e9-d04027d5b275 was qcow2, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:44:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:06 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 Jul 20 16:44:06 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:09 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" returned: 0 in 2.733s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_5mnmrsapdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:44:09 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Converted 112.00 MB image at 40.93 MB/s Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:09 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 1G Jul 20 16:44:09 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:09 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 1G" returned: 0 in 0.609s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Downloaded image aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 for user 72944c07010f4173b95a093ac4198aa3 is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Marking volume 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Copying metadata from image aa995944-e655-43b4-81e9-d04027d5b275 to 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Creating volume glance metadata for volume 4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 backed by image aa995944-e655-43b4-81e9-d04027d5b275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d86893b-75e9-4fb0-964b-9f39ec034462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678a1ac3-3054-464e-a07a-d2de86d6b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Volume volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 (4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7): created successfully Jul 20 16:44:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678a1ac3-3054-464e-a07a-d2de86d6b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Flow 'volume_create_manager' (ca086cef-9b4d-4751-960f-1416885fd181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:10 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0543d253-691f-4aa7-a7b5-5858cdb46f93 tempest-VolumesExtendTest-971669574 None] Created volume successfully. Jul 20 16:44:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dbb71a-50d4-40d7-8def-05bb028de9da]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:11 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 Jul 20 16:44:11 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:11 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" returned: 0 in 0.786s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 2G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 2G" returned: 0 in 0.207s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.080s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6a18dc04-0e8b-4dbc-987d-a15e631a09ca tempest-VolumesExtendTest-971669574 None] Extend volume completed successfully. Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Lock "cinder-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-quobyte-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db264c5-674e-482b-8bbc-bdb5d21b3ef9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:13 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 Jul 20 16:44:13 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:13 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" returned: 0 in 0.405s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:13 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7 Jul 20 16:44:13 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:14 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" returned: 0 in 0.334s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7" released by "delete_volume" :: held 0.798s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Created reservations ['74afe90d-7100-4440-bf1c-8d4c97976069', 'e46e4b05-e5d6-4839-beec-5a25ff4a4db1', '4007264b-75c0-4244-be4a-c2921bbfbccf', '5f4bbe63-2971-4c24-8fd1-335337b83479'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:14 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:44:14 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Acquiring lock "cinder-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:14 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.444s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "cinder-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Deleted volume successfully. Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fc733032-034f-49a8-8f36-8004fbbc8671 tempest-VolumesExtendTest-971669574 None] Lock "cinder-4ebab6fa-f2f4-4a21-a41f-e134bb1ceaa7-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Acquiring lock "cinder-quobyte-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "cinder-quobyte-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a0bffc-ed4d-440b-b0dd-c415b43b3896]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:15 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a Jul 20 16:44:15 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:44:15 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Flow 'volume_create_manager' (c46ff7c8-2fc4-484c-b34e-11663841881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb3ba1-b108-40b3-aa7b-eeeb3396ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a" returned: 0 in 0.534s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb3ba1-b108-40b3-aa7b-eeeb3396ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1792903070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5501886-f453-4bca-acbd-0e4e0882893b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af72e7895344d01a886a022dd17c785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:15Z,use_quota=True,user_id='72944c07010f4173b95a093ac4198aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ad3f9b-b23b-4ab5-b01d-fb85e25f38c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:15 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a Jul 20 16:44:15 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ad3f9b-b23b-4ab5-b01d-fb85e25f38c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbb702c-1dc8-402b-9f58-015e3a6e6b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbb702c-1dc8-402b-9f58-015e3a6e6b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5501886-f453-4bca-acbd-0e4e0882893b', 'volume_name': 'volume-b5501886-f453-4bca-acbd-0e4e0882893b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd9888-8a8c-45ce-8d96-f0d6afa5ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd9888-8a8c-45ce-8d96-f0d6afa5ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722c5737-07cb-40f4-9f2a-7355f73e775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Volume b5501886-f453-4bca-acbd-0e4e0882893b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5501886-f453-4bca-acbd-0e4e0882893b', 'volume_size': 1} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1792903070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5501886-f453-4bca-acbd-0e4e0882893b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4af72e7895344d01a886a022dd17c785',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:15Z,use_quota=True,user_id='72944c07010f4173b95a093ac4198aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Creating volume b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:44:15 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:15 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b 1073741824 Jul 20 16:44:15 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:15 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a" returned: 0 in 0.303s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "cinder-quobyte-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a" released by "delete_volume" :: held 0.891s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Created reservations ['c0f6a936-de15-4690-b3fc-4479b7ae50ee', 'eb94d64b-5dd3-41c0-b0a1-0a4e9d6190b9', '1bcced4c-8908-481a-953b-c2301cd8bc6e', 'e24ca371-a0e6-4791-8f54-06ec6a913eaa'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:16 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:44:16 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:16 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b 1073741824" returned: 0 in 0.707s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:16 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:44:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Deleted volume successfully. Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9492886f-c51b-4d42-97a3-31b4f6fec6a0 tempest-ServerRescueNegativeTestJSON-1417844497 None] Lock "cinder-4004d6f3-4340-4d7c-9a29-f3a4f1d4af2a-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:16 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b Jul 20 16:44:16 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:16 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722c5737-07cb-40f4-9f2a-7355f73e775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5501886-f453-4bca-acbd-0e4e0882893b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e35ccc0-847d-459e-812a-c5381d446470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Volume volume-b5501886-f453-4bca-acbd-0e4e0882893b (b5501886-f453-4bca-acbd-0e4e0882893b): created successfully Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e35ccc0-847d-459e-812a-c5381d446470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Flow 'volume_create_manager' (c46ff7c8-2fc4-484c-b34e-11663841881c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-75ad454b-efe5-4e38-81df-3b02d16d2364 tempest-VolumesExtendTest-971669574 None] Created volume successfully. Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Creating offline snapshot 12cf40aa-1911-477e-8750-b38751fc8a79 of volume b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dce964c-6b56-43b4-85f5-cd26b3e58e59]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:18 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b Jul 20 16:44:18 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:18 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b" returned: 0 in 0.653s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:18 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 1G Jul 20 16:44:18 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:19 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 1G" returned: 0 in 0.916s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5501886-f453-4bca-acbd-0e4e0882893b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:19 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5501886-f453-4bca-acbd-0e4e0882893b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 Jul 20 16:44:19 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:20 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5501886-f453-4bca-acbd-0e4e0882893b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79" returned: 0 in 0.516s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:20 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 is being set with open permissions: ugo+rw Jul 20 16:44:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:20 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 Jul 20 16:44:20 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:20 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79" returned: 0 in 0.322s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:20 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info Jul 20 16:44:20 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:21 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info" returned: 0 in 0.415s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:21 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info is being set with open permissions: ugo+rw Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:21 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info Jul 20 16:44:21 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:21 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.info" returned: 0 in 0.418s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.422s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-43272032-bf78-4927-89a9-190ed8656bee tempest-VolumesExtendTest-971669574 None] Create snapshot completed successfully Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Flow 'volume_create_manager' (cab768a5-7832-42d1-8215-724b716d7d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6699c44-a612-4203-9304-37b9d9e5f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6699c44-a612-4203-9304-37b9d9e5f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1539108399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa99edc-7bb0-424e-902b-a4456abaf3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea71ecf48044b5980ed942667e66bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:22Z,use_quota=True,user_id='c03af9a51749404e9a80368d9ee64bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdad021d-1005-4be1-b04e-03ab14d9e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdad021d-1005-4be1-b04e-03ab14d9e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd4e686-8761-4aa9-b738-783b47f73248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd4e686-8761-4aa9-b738-783b47f73248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa99edc-7bb0-424e-902b-a4456abaf3fb', 'volume_name': 'volume-baa99edc-7bb0-424e-902b-a4456abaf3fb', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7d7a90-a3af-47c7-89d9-2855bf10b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7d7a90-a3af-47c7-89d9-2855bf10b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8ad2b5-d617-4d25-81a9-f3c43256e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Volume baa99edc-7bb0-424e-902b-a4456abaf3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa99edc-7bb0-424e-902b-a4456abaf3fb', 'volume_size': 1} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1539108399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa99edc-7bb0-424e-902b-a4456abaf3fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea71ecf48044b5980ed942667e66bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:22Z,use_quota=True,user_id='c03af9a51749404e9a80368d9ee64bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Creating volume baa99edc-7bb0-424e-902b-a4456abaf3fb {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:44:21 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:44:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:21 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb 1073741824 Jul 20 16:44:21 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:22 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb 1073741824" returned: 0 in 0.612s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:22 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb Jul 20 16:44:22 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:22 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb" returned: 0 in 0.418s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.216s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8ad2b5-d617-4d25-81a9-f3c43256e207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa99edc-7bb0-424e-902b-a4456abaf3fb', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1228fb-7176-4232-bfc3-fd219baefe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3869ce8b-d87a-4df7-8551-1c4695f3ad29]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Volume volume-baa99edc-7bb0-424e-902b-a4456abaf3fb (baa99edc-7bb0-424e-902b-a4456abaf3fb): created successfully Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1228fb-7176-4232-bfc3-fd219baefe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Flow 'volume_create_manager' (cab768a5-7832-42d1-8215-724b716d7d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:23 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-df94acd7-0169-4a05-baf7-d9e98312b07a tempest-AttachVolumeTestJSON-1010339889 None] Created volume successfully. Jul 20 16:44:23 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b Jul 20 16:44:23 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:23 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b" returned: 0 in 0.502s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 2G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 2G" returned: 0 in 0.146s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.718s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:23 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d077ec06-ff40-4fd5-ae9c-a8f69412bde2 tempest-VolumesExtendTest-971669574 None] Extend volume completed successfully. Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-12cf40aa-1911-477e-8750-b38751fc8a79-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Lock "cinder-12cf40aa-1911-477e-8750-b38751fc8a79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-quobyte-b5501886-f453-4bca-acbd-0e4e0882893b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-b5501886-f453-4bca-acbd-0e4e0882893b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-quobyte-12cf40aa-1911-477e-8750-b38751fc8a79" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-12cf40aa-1911-477e-8750-b38751fc8a79" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Deleting offline snapshot 12cf40aa-1911-477e-8750-b38751fc8a79 of volume b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] snapshot_file for this snap is: volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a76f51-0491-4e2d-84ab-77fa179721d8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:24 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 Jul 20 16:44:24 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-ee658b94-cb29-49f6-92e7-243b6b71d049 req-3dc97109-1994-4d17-a90e-33a0adb683c3 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-ee658b94-cb29-49f6-92e7-243b6b71d049 req-3dc97109-1994-4d17-a90e-33a0adb683c3 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-ee658b94-cb29-49f6-92e7-243b6b71d049 req-3dc97109-1994-4d17-a90e-33a0adb683c3 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-ee658b94-cb29-49f6-92e7-243b6b71d049 req-3dc97109-1994-4d17-a90e-33a0adb683c3 tempest-AttachVolumeTestJSON-1010339889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-baa99edc-7bb0-424e-902b-a4456abaf3fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6eac8dd9-8691-4dc6-9045-5c343342d3bf', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:44:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-ee658b94-cb29-49f6-92e7-243b6b71d049 req-3dc97109-1994-4d17-a90e-33a0adb683c3 tempest-AttachVolumeTestJSON-1010339889 None] attachment_update completed successfully. Jul 20 16:44:24 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79" returned: 0 in 0.510s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5501886-f453-4bca-acbd-0e4e0882893b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59fb698-1119-4eb4-a023-7b6c657db2c5]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:24 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b Jul 20 16:44:24 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:25 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b" returned: 0 in 0.601s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:25 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 Jul 20 16:44:25 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:25 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79" returned: 0 in 0.473s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:25 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79 Jul 20 16:44:25 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:26 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b.12cf40aa-1911-477e-8750-b38751fc8a79" returned: 0 in 0.313s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-12cf40aa-1911-477e-8750-b38751fc8a79" released by "_delete_snapshot" :: held 2.068s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-b5501886-f453-4bca-acbd-0e4e0882893b" released by "delete_snapshot" :: held 2.108s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:26 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Created reservations ['9aa0b5ae-60fa-4fb2-9557-8d93f996295f', '8dd3448f-ef32-4be8-911e-374431fd3354', '63ddba39-6eaf-47ad-ac35-856846683941', '71e22ae5-8d88-437a-9616-ac596c9c0b22'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:26 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Delete snapshot completed successfully. Jul 20 16:44:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-613ef405-7736-4071-a429-33f655588bb9 tempest-VolumesExtendTest-971669574 None] Lock "cinder-12cf40aa-1911-477e-8750-b38751fc8a79-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Flow 'volume_create_manager' (6fde0ac2-33fa-4ff6-b4a4-646834fa2cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc20bee-ffed-497f-a255-5839c1900958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-b5501886-f453-4bca-acbd-0e4e0882893b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc20bee-ffed-497f-a255-5839c1900958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453814433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cec75e8-d75a-4b11-82ae-e92bd1c8d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea71ecf48044b5980ed942667e66bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:27Z,use_quota=True,user_id='c03af9a51749404e9a80368d9ee64bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3311a47a-20f6-4580-bf7d-cf11c495de9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3311a47a-20f6-4580-bf7d-cf11c495de9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5320bb2b-c7eb-4e55-8a8d-c5a1afb16cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5320bb2b-c7eb-4e55-8a8d-c5a1afb16cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cec75e8-d75a-4b11-82ae-e92bd1c8d51e', 'volume_name': 'volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a392cf0-c6b9-4b66-a86e-e9922a3075c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a392cf0-c6b9-4b66-a86e-e9922a3075c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe4fcff-cd47-4183-8359-a6b1ddf2cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:27 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Volume 8cec75e8-d75a-4b11-82ae-e92bd1c8d51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e', 'volume_size': 1} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1453814433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cec75e8-d75a-4b11-82ae-e92bd1c8d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bea71ecf48044b5980ed942667e66bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:44:27Z,use_quota=True,user_id='c03af9a51749404e9a80368d9ee64bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Creating volume 8cec75e8-d75a-4b11-82ae-e92bd1c8d51e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:44:27 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Lock "cinder-b5501886-f453-4bca-acbd-0e4e0882893b-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:27 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e 1073741824 Jul 20 16:44:27 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Acquiring lock "cinder-quobyte-b5501886-f453-4bca-acbd-0e4e0882893b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-b5501886-f453-4bca-acbd-0e4e0882893b" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[801706f3-de8b-4913-944e-36168af58af2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:27 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b Jul 20 16:44:27 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:28 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:28 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e 1073741824" returned: 0 in 0.768s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b" returned: 0 in 0.650s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:28 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b Jul 20 16:44:28 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:28 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e Jul 20 16:44:28 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:28 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b5501886-f453-4bca-acbd-0e4e0882893b" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Lock "cinder-quobyte-b5501886-f453-4bca-acbd-0e4e0882893b" released by "delete_volume" :: held 1.135s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:28 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e" returned: 0 in 0.361s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe4fcff-cd47-4183-8359-a6b1ddf2cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a105d7a-5fee-423c-a833-5be25d93d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:44:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Volume volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e (8cec75e8-d75a-4b11-82ae-e92bd1c8d51e): created successfully Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a105d7a-5fee-423c-a833-5be25d93d14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Flow 'volume_create_manager' (6fde0ac2-33fa-4ff6-b4a4-646834fa2cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:44:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8fa35b3a-e6d7-44e9-9dae-2dc089917d33 tempest-AttachVolumeTestJSON-1010339889 None] Created volume successfully. Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Created reservations ['3e54614e-aab1-4ef7-9210-28f58cc89936', 'cdee2096-e51e-4c8c-8f97-006c7270f467', '1ac9efd9-942f-4ec7-95a2-96b4f24a319a', '621fcdd4-1b16-4dec-a06d-3b990cd5549c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:29 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:44:29 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:29 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.351s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:29 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:44:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Deleted volume successfully. Jul 20 16:44:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41498a58-c75c-45ad-a6c3-2c91baeffe87 tempest-VolumesExtendTest-971669574 None] Lock "cinder-b5501886-f453-4bca-acbd-0e4e0882893b-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-19b6f096-b55c-41c7-a3f9-ef404b47c219 req-93ef43fd-f1f3-4b91-8e3a-57ac2667da5d tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-19b6f096-b55c-41c7-a3f9-ef404b47c219 req-93ef43fd-f1f3-4b91-8e3a-57ac2667da5d tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-19b6f096-b55c-41c7-a3f9-ef404b47c219 req-93ef43fd-f1f3-4b91-8e3a-57ac2667da5d tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-19b6f096-b55c-41c7-a3f9-ef404b47c219 req-93ef43fd-f1f3-4b91-8e3a-57ac2667da5d tempest-AttachVolumeTestJSON-1010339889 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9abcea76-3e1e-46ce-96ae-79aa6d574ae4', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:44:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-19b6f096-b55c-41c7-a3f9-ef404b47c219 req-93ef43fd-f1f3-4b91-8e3a-57ac2667da5d tempest-AttachVolumeTestJSON-1010339889 None] attachment_update completed successfully. Jul 20 16:44:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-76314658-e10f-4500-98cc-fb989b8f8c8d req-ed6e0276-6be1-46ec-be98-d76c6c9a365a tempest-AttachVolumeTestJSON-1010339889 None] Terminate volume connection completed successfully. Jul 20 16:44:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-76314658-e10f-4500-98cc-fb989b8f8c8d req-ed6e0276-6be1-46ec-be98-d76c6c9a365a tempest-AttachVolumeTestJSON-1010339889 None] Deleting attachment 6eac8dd9-8691-4dc6-9045-5c343342d3bf. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:44:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-5f82a67f-3323-46b7-aa8f-1bfb380b6979 req-e13f2d73-ae2f-48d2-a30a-01c5e1b5b42a tempest-AttachVolumeTestJSON-1010339889 None] Terminate volume connection completed successfully. Jul 20 16:44:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-5f82a67f-3323-46b7-aa8f-1bfb380b6979 req-e13f2d73-ae2f-48d2-a30a-01c5e1b5b42a tempest-AttachVolumeTestJSON-1010339889 None] Deleting attachment 9abcea76-3e1e-46ce-96ae-79aa6d574ae4. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:39 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:44:39 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:39 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.524s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:44:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:44:45 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=56,cinder:SELECT=59,cinder:INSERT=21,cinder:DELETE=2 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:44:45 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=60,cinder:UPDATE=55,cinder:DELETE=7,cinder:INSERT=14 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "cinder-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "cinder-quobyte-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-quobyte-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[64450db1-0ab2-44c6-8f93-620b34fa1df6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:54 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e Jul 20 16:44:54 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:54 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e" returned: 0 in 0.405s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:54 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e Jul 20 16:44:54 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:54 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e" returned: 0 in 0.290s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-quobyte-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e" released by "delete_volume" :: held 0.747s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:54 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Created reservations ['0e6ff75e-b120-4095-a277-35658996f6be', 'c4d0e0a6-3fa7-43c7-b7d9-ad5aae95e8b0', '4eec0072-d6d1-4c1e-9c94-7d1304429ef6', '52378362-840d-4444-bf5e-020fba99f08e'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:55 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:44:55 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "cinder-baa99edc-7bb0-424e-902b-a4456abaf3fb-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-baa99edc-7bb0-424e-902b-a4456abaf3fb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "cinder-quobyte-baa99edc-7bb0-424e-902b-a4456abaf3fb" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-quobyte-baa99edc-7bb0-424e-902b-a4456abaf3fb" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c386f47-fdb7-4ccc-ad59-b868d2083b6d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:55 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.484s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:44:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Deleted volume successfully. Jul 20 16:44:55 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb Jul 20 16:44:55 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-919ff2d3-04d4-4015-b175-1a9667e25c9d tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-8cec75e8-d75a-4b11-82ae-e92bd1c8d51e-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:56 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb" returned: 0 in 0.822s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:56 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb Jul 20 16:44:56 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:56 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-baa99edc-7bb0-424e-902b-a4456abaf3fb" returned: 0 in 0.629s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-quobyte-baa99edc-7bb0-424e-902b-a4456abaf3fb" released by "delete_volume" :: held 1.541s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Created reservations ['4bb36b0e-18a6-433c-8ca4-3e79da2027f2', '1b38e1d0-427f-48a5-8a15-b4cbbd02ea33', '6d9f4bf6-a4fe-410e-91df-18ac4b30ebde', 'd26da3b7-9f36-41cc-b93f-40c880f3defb'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:57 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:44:57 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:57 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:44:57 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Deleted volume successfully. Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05f471e7-4717-463a-b82d-4a2f9348bb47 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-baa99edc-7bb0-424e-902b-a4456abaf3fb-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "cinder-f7152e95-a756-4c26-ae33-ed2e7eda0c8e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-f7152e95-a756-4c26-ae33-ed2e7eda0c8e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "cinder-quobyte-f7152e95-a756-4c26-ae33-ed2e7eda0c8e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:44:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-quobyte-f7152e95-a756-4c26-ae33-ed2e7eda0c8e" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:44:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab7dedb-3aba-4f41-819d-f9ab2d58478e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:44:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:58 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e Jul 20 16:44:58 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:58 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e" returned: 0 in 0.875s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:44:59 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e Jul 20 16:44:59 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:44:59 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Jul 20 16:44:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7152e95-a756-4c26-ae33-ed2e7eda0c8e" returned: 0 in 0.556s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:44:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-quobyte-f7152e95-a756-4c26-ae33-ed2e7eda0c8e" released by "delete_volume" :: held 1.571s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:44:59 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Created reservations ['025213aa-417b-47ff-add7-f96f849e58b0', 'e753922f-2266-409d-bbfd-5ba4d5e2725d', '3cb3c475-ccbe-4352-8004-692df02d62d6', '7e32eaf1-e155-4e79-9241-bde0e430691b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:44:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:44:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:44:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:00 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:00 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:00 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.543s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:00 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Deleted volume successfully. Jul 20 16:45:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a3a10ecc-d3e2-49f2-afbd-4f29d4deb047 tempest-AttachVolumeTestJSON-1010339889 None] Lock "cinder-f7152e95-a756-4c26-ae33-ed2e7eda0c8e-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Flow 'volume_create_manager' (4fefdd9b-3241-49eb-a33d-bec82500b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fa532-c5f8-40c5-b648-c2b61c188dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fa532-c5f8-40c5-b648-c2b61c188dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1029500498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa1d682-8084-4c78-a78d-ee84f8d11bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf31e424640246cbbd57706a10bc2e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:09Z,use_quota=True,user_id='cfe554243ce9480a82502ad9379dc477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9378c37-8d74-4662-b8fa-9328b92956a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9378c37-8d74-4662-b8fa-9328b92956a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f9ec02-6455-40dc-89ec-c5aface252bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f9ec02-6455-40dc-89ec-c5aface252bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa1d682-8084-4c78-a78d-ee84f8d11bb9', 'volume_name': 'volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9461b8-e3f7-4e03-a941-6817d0e06aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9461b8-e3f7-4e03-a941-6817d0e06aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a24712d-6e54-497a-a90b-d61192172000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Volume eaa1d682-8084-4c78-a78d-ee84f8d11bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9', 'volume_size': 1} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1029500498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa1d682-8084-4c78-a78d-ee84f8d11bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf31e424640246cbbd57706a10bc2e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:09Z,use_quota=True,user_id='cfe554243ce9480a82502ad9379dc477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Creating volume eaa1d682-8084-4c78-a78d-ee84f8d11bb9 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:09 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:09 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 1073741824 Jul 20 16:45:09 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:10 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 1073741824" returned: 0 in 0.916s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:10 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 Jul 20 16:45:10 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:11 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9" returned: 0 in 0.659s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a24712d-6e54-497a-a90b-d61192172000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f18d294-2f2f-46ee-903c-c51cad44665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:11 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Volume volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 (eaa1d682-8084-4c78-a78d-ee84f8d11bb9): created successfully Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f18d294-2f2f-46ee-903c-c51cad44665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Flow 'volume_create_manager' (4fefdd9b-3241-49eb-a33d-bec82500b565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-dd2de9df-b739-458e-9605-f46ddbd2f496 tempest-ServersNegativeTestJSON-1363672984 None] Created volume successfully. Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Flow 'volume_create_manager' (53c5adc2-04b4-4f8e-a9f4-01617f568418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36b2a42-8bbd-4c0a-84cd-ceb3039e772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36b2a42-8bbd-4c0a-84cd-ceb3039e772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1682056915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ce68f996b4b148b98ea67676dc2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:12Z,use_quota=True,user_id='a5251b09ae3a4bf8908407de2e61b25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02acce73-7c50-415e-9bbb-6a04506f10b0),volume_type_id=02acce73-7c50-415e-9bbb-6a04506f10b0)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a45955-110f-4c0a-9f12-70cfde7cc7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a45955-110f-4c0a-9f12-70cfde7cc7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c6de09-b2b5-47fe-a7a7-a8f4719ba3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c6de09-b2b5-47fe-a7a7-a8f4719ba3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0', 'volume_name': 'volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fbdc42-26f4-40a4-853b-b23208aa19c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fbdc42-26f4-40a4-853b-b23208aa19c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2655c42-23c4-4ef8-b30e-2e7f064b26f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:11 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0', 'volume_size': 1} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1682056915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ce68f996b4b148b98ea67676dc2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:12Z,use_quota=True,user_id='a5251b09ae3a4bf8908407de2e61b25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02acce73-7c50-415e-9bbb-6a04506f10b0),volume_type_id=02acce73-7c50-415e-9bbb-6a04506f10b0)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Creating volume e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:11 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:11 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 1073741824 Jul 20 16:45:11 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Flow 'volume_create_manager' (25ac9050-3ffa-4517-9fe5-6034bd00afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86846bb-8dbd-4deb-a5f0-0986e413d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86846bb-8dbd-4deb-a5f0-0986e413d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1860195123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353de5cd-a30a-40fd-a497-f9ceede8f797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ce68f996b4b148b98ea67676dc2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:12Z,use_quota=True,user_id='a5251b09ae3a4bf8908407de2e61b25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07381654-727f-430c-a3e7-ef56d9def11e),volume_type_id=07381654-727f-430c-a3e7-ef56d9def11e)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88be7e16-510f-46b0-9efb-76259c29add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88be7e16-510f-46b0-9efb-76259c29add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7f515f-8b6f-4c13-9f7e-130d6954fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7f515f-8b6f-4c13-9f7e-130d6954fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353de5cd-a30a-40fd-a497-f9ceede8f797', 'volume_name': 'volume-353de5cd-a30a-40fd-a497-f9ceede8f797', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221f200c-f60d-4eaf-bb0f-b32e54d26982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221f200c-f60d-4eaf-bb0f-b32e54d26982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defd054d-be90-4b0c-9d4f-8576a4e7d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume 353de5cd-a30a-40fd-a497-f9ceede8f797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353de5cd-a30a-40fd-a497-f9ceede8f797', 'volume_size': 1} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:12 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 1073741824" returned: 0 in 0.931s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:12 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 Jul 20 16:45:12 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:13 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0" returned: 0 in 0.558s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1860195123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353de5cd-a30a-40fd-a497-f9ceede8f797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ce68f996b4b148b98ea67676dc2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:12Z,use_quota=True,user_id='a5251b09ae3a4bf8908407de2e61b25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07381654-727f-430c-a3e7-ef56d9def11e),volume_type_id=07381654-727f-430c-a3e7-ef56d9def11e)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Creating volume 353de5cd-a30a-40fd-a497-f9ceede8f797 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:13 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2655c42-23c4-4ef8-b30e-2e7f064b26f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:13 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 1073741824 Jul 20 16:45:13 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13daf6e8-2762-4b8e-90bc-d1d5fd39defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 (e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0): created successfully Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13daf6e8-2762-4b8e-90bc-d1d5fd39defe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Flow 'volume_create_manager' (53c5adc2-04b4-4f8e-a9f4-01617f568418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d37b5202-63e4-4bfc-8326-1bc12dfa9a23 tempest-TestInstancesWithCinderVolumes-2014490119 None] Created volume successfully. Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Flow 'volume_create_manager' (4a32b7f3-e3a9-4bfb-9c3a-d3b284e12931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:14 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77edb6f-32d0-4d68-9b8d-deeb883a3c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 1073741824" returned: 0 in 0.786s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77edb6f-32d0-4d68-9b8d-deeb883a3c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-167186283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f8918b-baa4-4503-8b35-29728e745b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ce68f996b4b148b98ea67676dc2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:14Z,use_quota=True,user_id='a5251b09ae3a4bf8908407de2e61b25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebddb83-97a7-4828-951d-12833f528079),volume_type_id=3ebddb83-97a7-4828-951d-12833f528079)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d076d8c8-788a-4e5d-867e-d64925d694db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d076d8c8-788a-4e5d-867e-d64925d694db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc25844-f150-4de4-a659-99a74e09e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:14 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 Jul 20 16:45:14 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:14 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797" returned: 0 in 0.455s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defd054d-be90-4b0c-9d4f-8576a4e7d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353de5cd-a30a-40fd-a497-f9ceede8f797', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49888747-bb27-4e7c-9b32-d0331028ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume volume-353de5cd-a30a-40fd-a497-f9ceede8f797 (353de5cd-a30a-40fd-a497-f9ceede8f797): created successfully Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49888747-bb27-4e7c-9b32-d0331028ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Flow 'volume_create_manager' (25ac9050-3ffa-4517-9fe5-6034bd00afdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-289b7f2a-3d14-48d7-bb6f-d8cd57f2b9dc tempest-TestInstancesWithCinderVolumes-2014490119 None] Created volume successfully. Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc25844-f150-4de4-a659-99a74e09e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95f8918b-baa4-4503-8b35-29728e745b71', 'volume_name': 'volume-95f8918b-baa4-4503-8b35-29728e745b71', 'volume_size': 1, 'image_id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--713862182', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '315ce68f996b4b148b98ea67676dc2fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'created_at': datetime.datetime(2026, 7, 20, 14, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 45, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f/file', 'properties': {}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2252553-d181-43cf-8ef1-f47cde5dcab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2252553-d181-43cf-8ef1-f47cde5dcab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc10173-75c6-4fb3-ad71-9939f36b48b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume 95f8918b-baa4-4503-8b35-29728e745b71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95f8918b-baa4-4503-8b35-29728e745b71', 'volume_size': 1, 'image_id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--713862182', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '315ce68f996b4b148b98ea67676dc2fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'created_at': datetime.datetime(2026, 7, 20, 14, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 45, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f/file', 'properties': {}}, 'image_service': } Jul 20 16:45:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Trying to clone 95f8918b-baa4-4503-8b35-29728e745b71 from image e4d1c1dc-5e16-4941-b813-98b0fc6ef03f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Flow 'volume_create_manager' (4671aa59-39fe-48b1-a7e5-9b67de4f1afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dadab2-5d8a-47a5-b0f5-ebffec4d8884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dadab2-5d8a-47a5-b0f5-ebffec4d8884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-509083496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d8a090-8418-44f9-9fc5-7f34147dfda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf31e424640246cbbd57706a10bc2e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:15Z,use_quota=True,user_id='cfe554243ce9480a82502ad9379dc477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a84da-b2a9-4298-8d5c-ac2f8ea4f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889a84da-b2a9-4298-8d5c-ac2f8ea4f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e371c1-c8a5-4414-a9fe-a7404ef446d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e371c1-c8a5-4414-a9fe-a7404ef446d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d8a090-8418-44f9-9fc5-7f34147dfda4', 'volume_name': 'volume-18d8a090-8418-44f9-9fc5-7f34147dfda4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a55759-3ab5-48cb-aa76-43e833fd7cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a55759-3ab5-48cb-aa76-43e833fd7cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87e8233-9ddb-48b4-9d34-075396e158bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Volume 18d8a090-8418-44f9-9fc5-7f34147dfda4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d8a090-8418-44f9-9fc5-7f34147dfda4', 'volume_size': 1} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-509083496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d8a090-8418-44f9-9fc5-7f34147dfda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf31e424640246cbbd57706a10bc2e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:15Z,use_quota=True,user_id='cfe554243ce9480a82502ad9379dc477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Creating volume 18d8a090-8418-44f9-9fc5-7f34147dfda4 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:15 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:15 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 1073741824 Jul 20 16:45:15 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:15 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 1073741824" returned: 0 in 0.506s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:15 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 Jul 20 16:45:15 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:16 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4" returned: 0 in 0.364s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87e8233-9ddb-48b4-9d34-075396e158bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d8a090-8418-44f9-9fc5-7f34147dfda4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2aed13e-c7a7-431b-aa3b-0fa6216723e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Volume volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 (18d8a090-8418-44f9-9fc5-7f34147dfda4): created successfully Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2aed13e-c7a7-431b-aa3b-0fa6216723e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Flow 'volume_create_manager' (4671aa59-39fe-48b1-a7e5-9b67de4f1afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-884dbb0d-581f-4210-831b-c324224e88ab tempest-ServersNegativeTestJSON-1363672984 None] Created volume successfully. Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Flow 'volume_create_manager' (c53f26d4-3bb0-4fa3-9a9d-3c6b64fa0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b725d03a-9d1f-4518-b428-9d9725d127f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b725d03a-9d1f-4518-b428-9d9725d127f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-334795245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6900c0-5841-4753-9f60-0482d505ea78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378031fd658f43dbaaf1f51edd96c0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:17Z,use_quota=True,user_id='798baddd86404edea0a34d92fed90ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448e363c-1532-4d83-95b3-8d838df8a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448e363c-1532-4d83-95b3-8d838df8a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c0f342-14df-4d5f-b514-8711f338738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c0f342-14df-4d5f-b514-8711f338738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6900c0-5841-4753-9f60-0482d505ea78', 'volume_name': 'volume-5c6900c0-5841-4753-9f60-0482d505ea78', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53affb3-e271-49c4-bce3-6f8a66e9b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53affb3-e271-49c4-bce3-6f8a66e9b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5d0ff7-0f0d-4f19-a0bd-d45f9b929590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:17 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Volume 5c6900c0-5841-4753-9f60-0482d505ea78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6900c0-5841-4753-9f60-0482d505ea78', 'volume_size': 1} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-334795245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6900c0-5841-4753-9f60-0482d505ea78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378031fd658f43dbaaf1f51edd96c0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:17Z,use_quota=True,user_id='798baddd86404edea0a34d92fed90ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Creating volume 5c6900c0-5841-4753-9f60-0482d505ea78 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:17 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:17 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 1073741824 Jul 20 16:45:17 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "cinder-18d8a090-8418-44f9-9fc5-7f34147dfda4-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-18d8a090-8418-44f9-9fc5-7f34147dfda4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "cinder-quobyte-18d8a090-8418-44f9-9fc5-7f34147dfda4" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-quobyte-18d8a090-8418-44f9-9fc5-7f34147dfda4" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42823f-7b79-4bd5-ad60-82b22458a56d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:18 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 Jul 20 16:45:18 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:18 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 1073741824" returned: 0 in 0.526s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:18 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 Jul 20 16:45:18 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:18 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4" returned: 0 in 0.483s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:18 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4 Jul 20 16:45:18 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:18 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78" returned: 0 in 0.333s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5d0ff7-0f0d-4f19-a0bd-d45f9b929590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6900c0-5841-4753-9f60-0482d505ea78', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1ea4ef-2be0-462b-8041-3e36bd321eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:18 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Volume volume-5c6900c0-5841-4753-9f60-0482d505ea78 (5c6900c0-5841-4753-9f60-0482d505ea78): created successfully Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1ea4ef-2be0-462b-8041-3e36bd321eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Flow 'volume_create_manager' (c53f26d4-3bb0-4fa3-9a9d-3c6b64fa0b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-eb0d1a50-700b-41e8-9788-7ec8ccbd1da7 tempest-VolumesTestJSON-506715054 None] Created volume successfully. Jul 20 16:45:18 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-18d8a090-8418-44f9-9fc5-7f34147dfda4" returned: 0 in 0.317s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-quobyte-18d8a090-8418-44f9-9fc5-7f34147dfda4" released by "delete_volume" :: held 0.846s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Created reservations ['554c368d-fe29-4903-967b-adf9031e5c63', '2e65b134-a224-4d01-b27a-0ffa2257145c', '8d69de73-ec50-4138-ae84-625032f16e71', '5de8fb81-59d5-4785-a503-e2e6abe1da87'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:18 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:18 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "cinder-eaa1d682-8084-4c78-a78d-ee84f8d11bb9-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-eaa1d682-8084-4c78-a78d-ee84f8d11bb9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "cinder-quobyte-eaa1d682-8084-4c78-a78d-ee84f8d11bb9" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-quobyte-eaa1d682-8084-4c78-a78d-ee84f8d11bb9" acquired by "delete_volume" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf4b962-d74b-4e87-8645-a299c38b0c41]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:19 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Deleted volume successfully. Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02640be9-f6b7-4579-ad48-775bd571862b tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-18d8a090-8418-44f9-9fc5-7f34147dfda4-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:19 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 Jul 20 16:45:19 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:19 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9" returned: 0 in 0.459s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:19 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9 Jul 20 16:45:19 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:19 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-eaa1d682-8084-4c78-a78d-ee84f8d11bb9" returned: 0 in 0.294s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-quobyte-eaa1d682-8084-4c78-a78d-ee84f8d11bb9" released by "delete_volume" :: held 0.809s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Created reservations ['8a063c0e-d3b4-4835-abaf-5f95f6e1766c', '7776db9f-9f53-4bfa-bb35-8cdcb3f2f14b', '984cc285-906a-494d-8b55-9e954f964258', 'febdaf64-aaed-42f9-b071-6b168eaae9ee'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Flow 'volume_create_manager' (da42d917-d5ef-4005-96b9-0d8ca8373e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c87d5f-5a69-4bdf-a52f-960009ab3f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c87d5f-5a69-4bdf-a52f-960009ab3f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1892807080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc783d22-64a5-4e8c-ad03-114ae6fb5514,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378031fd658f43dbaaf1f51edd96c0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:20Z,use_quota=True,user_id='798baddd86404edea0a34d92fed90ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7904e3bf-7670-4c6f-a103-a3ba065baa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7904e3bf-7670-4c6f-a103-a3ba065baa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bb99ee-82cd-4183-a303-f9255fc41147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bb99ee-82cd-4183-a303-f9255fc41147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc783d22-64a5-4e8c-ad03-114ae6fb5514', 'volume_name': 'volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e577e6-18c1-4fa8-bd0b-7490b2af273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e577e6-18c1-4fa8-bd0b-7490b2af273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee19cc-274d-4752-bdf5-2d19954c0dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:20 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Volume fc783d22-64a5-4e8c-ad03-114ae6fb5514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514', 'volume_size': 1} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1892807080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc783d22-64a5-4e8c-ad03-114ae6fb5514,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378031fd658f43dbaaf1f51edd96c0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:20Z,use_quota=True,user_id='798baddd86404edea0a34d92fed90ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Creating volume fc783d22-64a5-4e8c-ad03-114ae6fb5514 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:20 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:20 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 1073741824 Jul 20 16:45:20 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:20 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:20 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD, size 20.69 MB, duration 5.67 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:45:20 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Image download 20.69 MB at 3.65 MB/s Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d25bf-5566-4a4f-8e29-ded7f13ba773]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:20 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD Jul 20 16:45:20 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:20 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.505s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Deleted volume successfully. Jul 20 16:45:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9324147d-3dcf-4fad-afa6-c185da13721f tempest-ServersNegativeTestJSON-1363672984 None] Lock "cinder-eaa1d682-8084-4c78-a78d-ee84f8d11bb9-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:21 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Temporary image e4d1c1dc-5e16-4941-b813-98b0fc6ef03f is fetched for user a5251b09ae3a4bf8908407de2e61b25f. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:45:21 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 1073741824" returned: 0 in 0.964s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff52254-a6ed-4b2b-b447-5dba0362782b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:21 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 Jul 20 16:45:21 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:21 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD Jul 20 16:45:21 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:21 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514" returned: 0 in 0.328s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdee19cc-274d-4752-bdf5-2d19954c0dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803f5837-1dbb-490c-815d-7696b3bc20e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Volume volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 (fc783d22-64a5-4e8c-ad03-114ae6fb5514): created successfully Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803f5837-1dbb-490c-815d-7696b3bc20e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Flow 'volume_create_manager' (da42d917-d5ef-4005-96b9-0d8ca8373e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3885901b-1821-4568-bc2d-3bd584c69c5b tempest-VolumesTestJSON-506715054 None] Created volume successfully. Jul 20 16:45:21 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-167186283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f8918b-baa4-4503-8b35-29728e745b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315ce68f996b4b148b98ea67676dc2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:14Z,use_quota=True,user_id='a5251b09ae3a4bf8908407de2e61b25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ebddb83-97a7-4828-951d-12833f528079),volume_type_id=3ebddb83-97a7-4828-951d-12833f528079)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Creating volume 95f8918b-baa4-4503-8b35-29728e745b71 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:21 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:21 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 1073741824 Jul 20 16:45:21 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:22 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 1073741824" returned: 0 in 0.452s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:22 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 Jul 20 16:45:22 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:22 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Attempting download of e4d1c1dc-5e16-4941-b813-98b0fc6ef03f ((None, [{'url': 'file:///opt/stack/data/glance/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'metadata': {}}])) to volume 95f8918b-baa4-4503-8b35-29728e745b71. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8810612-f20b-4755-8cea-c0c620b11305]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:22 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g Jul 20 16:45:22 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Flow 'volume_create_manager' (42b13d6b-94d3-4ec1-b2fb-f6dcab57df8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea508c8-2d3e-4389-a181-72660dc198f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea508c8-2d3e-4389-a181-72660dc198f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1455477268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23eca05-c139-4dd6-8cbe-5168de4c676e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378031fd658f43dbaaf1f51edd96c0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:23Z,use_quota=True,user_id='798baddd86404edea0a34d92fed90ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3e70ea-e649-4fc4-98bd-1c0a93e296ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3e70ea-e649-4fc4-98bd-1c0a93e296ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4eed6c-3829-4da6-a9c3-cae6db0bcf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4eed6c-3829-4da6-a9c3-cae6db0bcf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23eca05-c139-4dd6-8cbe-5168de4c676e', 'volume_name': 'volume-b23eca05-c139-4dd6-8cbe-5168de4c676e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dda7db-0239-48ce-add5-b5e9a5840c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dda7db-0239-48ce-add5-b5e9a5840c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc108c3-8d6d-4c68-a43b-7fe2eb59a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:23 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Volume b23eca05-c139-4dd6-8cbe-5168de4c676e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23eca05-c139-4dd6-8cbe-5168de4c676e', 'volume_size': 1} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1455477268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23eca05-c139-4dd6-8cbe-5168de4c676e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='378031fd658f43dbaaf1f51edd96c0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:23Z,use_quota=True,user_id='798baddd86404edea0a34d92fed90ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Creating volume b23eca05-c139-4dd6-8cbe-5168de4c676e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:23 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:23 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:23 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e 1073741824 Jul 20 16:45:23 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:23 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g Jul 20 16:45:23 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:23 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g" returned: 1 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_kh_s3j_g' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07f9a8-516c-4021-bbe9-57f58c8aac18]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:23 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e 1073741824" returned: 0 in 0.416s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:23 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD Jul 20 16:45:23 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:23 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e Jul 20 16:45:23 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:23 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] e4d1c1dc-5e16-4941-b813-98b0fc6ef03f was qcow2, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:23 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e" returned: 0 in 0.265s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:23 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 Jul 20 16:45:23 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc108c3-8d6d-4c68-a43b-7fe2eb59a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23eca05-c139-4dd6-8cbe-5168de4c676e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d783c201-6086-4bdc-8908-210b46496ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:23 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Volume volume-b23eca05-c139-4dd6-8cbe-5168de4c676e (b23eca05-c139-4dd6-8cbe-5168de4c676e): created successfully Jul 20 16:45:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d783c201-6086-4bdc-8908-210b46496ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Flow 'volume_create_manager' (42b13d6b-94d3-4ec1-b2fb-f6dcab57df8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8de73353-fd6e-4210-89e6-d40f480a0966 tempest-VolumesTestJSON-506715054 None] Created volume successfully. Jul 20 16:45:25 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71" returned: 0 in 1.801s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:25 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4d1c1dc-5e16-4941-b813-98b0fc6ef03f_72lud1fadevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:45:25 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Converted 112.00 MB image at 62.16 MB/s Jul 20 16:45:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:25 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 1G Jul 20 16:45:25 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:26 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 1G" returned: 0 in 0.417s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Downloaded image e4d1c1dc-5e16-4941-b813-98b0fc6ef03f ((None, [{'url': 'file:///opt/stack/data/glance/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'metadata': {}}])) to volume 95f8918b-baa4-4503-8b35-29728e745b71 successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Temporary image e4d1c1dc-5e16-4941-b813-98b0fc6ef03f for user a5251b09ae3a4bf8908407de2e61b25f is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Marking volume 95f8918b-baa4-4503-8b35-29728e745b71 as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Copying metadata from image e4d1c1dc-5e16-4941-b813-98b0fc6ef03f to 95f8918b-baa4-4503-8b35-29728e745b71. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Creating volume glance metadata for volume 95f8918b-baa4-4503-8b35-29728e745b71 backed by image e4d1c1dc-5e16-4941-b813-98b0fc6ef03f with: {'image_id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'image_name': 'tempest-scenario-img--713862182', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Acquiring lock "cinder-b23eca05-c139-4dd6-8cbe-5168de4c676e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Lock "cinder-b23eca05-c139-4dd6-8cbe-5168de4c676e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Acquiring lock "cinder-quobyte-b23eca05-c139-4dd6-8cbe-5168de4c676e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc10173-75c6-4fb3-ad71-9939f36b48b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f8918b-baa4-4503-8b35-29728e745b71', 'volume_size': 1, 'image_id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--713862182', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '315ce68f996b4b148b98ea67676dc2fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e4d1c1dc-5e16-4941-b813-98b0fc6ef03f', 'created_at': datetime.datetime(2026, 7, 20, 14, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 45, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4d1c1dc-5e16-4941-b813-98b0fc6ef03f/file', 'properties': {}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce63d9d-40d3-4461-8c5d-41fdc45ee6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Lock "cinder-quobyte-b23eca05-c139-4dd6-8cbe-5168de4c676e" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:26 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Volume volume-95f8918b-baa4-4503-8b35-29728e745b71 (95f8918b-baa4-4503-8b35-29728e745b71): created successfully Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce63d9d-40d3-4461-8c5d-41fdc45ee6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Flow 'volume_create_manager' (4a32b7f3-e3a9-4bfb-9c3a-d3b284e12931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b66b02-94f3-4e2c-8885-963c2916b4b4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:26 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-627ad2be-7dcf-40ec-9002-57545dac2a6b tempest-TestInstancesWithCinderVolumes-2014490119 None] Created volume successfully. Jul 20 16:45:26 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e Jul 20 16:45:26 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:26 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:26 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e Jul 20 16:45:26 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:27 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b23eca05-c139-4dd6-8cbe-5168de4c676e" returned: 0 in 0.260s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Lock "cinder-quobyte-b23eca05-c139-4dd6-8cbe-5168de4c676e" released by "delete_volume" :: held 0.722s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Created reservations ['8e048461-0436-48f3-a8a0-3fd92b4069ed', 'cbe9fecd-a9d6-4a53-bcd7-8f7c437f9cb9', '3105506b-196a-4471-8d62-fc768ca6b8dd', '48432c79-a5b4-4dc7-80f3-a72da6267b86'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:27 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:27 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Acquiring lock "cinder-fc783d22-64a5-4e8c-ad03-114ae6fb5514-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Lock "cinder-fc783d22-64a5-4e8c-ad03-114ae6fb5514-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Acquiring lock "cinder-quobyte-fc783d22-64a5-4e8c-ad03-114ae6fb5514" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Lock "cinder-quobyte-fc783d22-64a5-4e8c-ad03-114ae6fb5514" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8169a920-7ec8-4611-98fe-eac7d6fb07db]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:27 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.562s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Deleted volume successfully. Jul 20 16:45:27 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 Jul 20 16:45:27 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9aedb15-d640-43e4-95d2-a83e734c8fa5 tempest-VolumesTestJSON-506715054 None] Lock "cinder-b23eca05-c139-4dd6-8cbe-5168de4c676e-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:28 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514" returned: 0 in 0.590s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:28 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514 Jul 20 16:45:28 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:28 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc783d22-64a5-4e8c-ad03-114ae6fb5514" returned: 0 in 0.309s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Lock "cinder-quobyte-fc783d22-64a5-4e8c-ad03-114ae6fb5514" released by "delete_volume" :: held 0.966s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Created reservations ['c8514c39-8f68-4735-8edd-06897d54a2e8', '4c01cc35-43bb-4a32-a886-38f0c0c4502f', '9d09cf08-5f0a-4a11-869b-086be81cb60a', '9ab151d2-8389-43a3-bcf9-9f245f47cd89'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:28 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:28 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Acquiring lock "cinder-5c6900c0-5841-4753-9f60-0482d505ea78-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Lock "cinder-5c6900c0-5841-4753-9f60-0482d505ea78-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Acquiring lock "cinder-quobyte-5c6900c0-5841-4753-9f60-0482d505ea78" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Lock "cinder-quobyte-5c6900c0-5841-4753-9f60-0482d505ea78" acquired by "delete_volume" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc52223-dc64-4e81-a9d3-f734a8449394]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:29 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.391s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Deleted volume successfully. Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b798a9ae-4e9d-43b1-b59f-8656b89ce24e tempest-VolumesTestJSON-506715054 None] Lock "cinder-fc783d22-64a5-4e8c-ad03-114ae6fb5514-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:29 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 Jul 20 16:45:29 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:29 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78" returned: 0 in 0.497s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:29 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78 Jul 20 16:45:29 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:29 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c6900c0-5841-4753-9f60-0482d505ea78" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Lock "cinder-quobyte-5c6900c0-5841-4753-9f60-0482d505ea78" released by "delete_volume" :: held 0.877s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:29 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Created reservations ['615ecf0c-ba4d-4f69-b265-ffdeddf8c451', '3dadcb4b-7773-47c8-bdba-b693596e07a0', 'a0271dc8-91e5-4670-bb93-862a0f59a9e0', 'da73c441-22f3-4183-8ba3-444649c18bfc'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:30 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:30 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:30 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.437s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Deleted volume successfully. Jul 20 16:45:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d284f595-25fc-4736-be60-ae8d32d15901 tempest-VolumesTestJSON-506715054 None] Lock "cinder-5c6900c0-5841-4753-9f60-0482d505ea78-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-ae1a12bf-6157-450d-b5b7-2f708c473c81 req-3e4c6555-e11c-489c-8c09-982d378ecfb6 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-ae1a12bf-6157-450d-b5b7-2f708c473c81 req-3e4c6555-e11c-489c-8c09-982d378ecfb6 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-ae1a12bf-6157-450d-b5b7-2f708c473c81 req-3e4c6555-e11c-489c-8c09-982d378ecfb6 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-ae1a12bf-6157-450d-b5b7-2f708c473c81 req-3e4c6555-e11c-489c-8c09-982d378ecfb6 tempest-TestInstancesWithCinderVolumes-2014490119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-95f8918b-baa4-4503-8b35-29728e745b71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b5ed796-765d-4679-9707-97ee97246212', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:45:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-ae1a12bf-6157-450d-b5b7-2f708c473c81 req-3e4c6555-e11c-489c-8c09-982d378ecfb6 tempest-TestInstancesWithCinderVolumes-2014490119 None] attachment_update completed successfully. Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Flow 'volume_create_manager' (448dd9c4-1c32-4870-b28f-7e209e9a6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b07288c-0b29-45f5-9b2f-9e7cc247c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b07288c-0b29-45f5-9b2f-9e7cc247c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191530522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad711df716f499c8c0436d5bb857304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:32Z,use_quota=True,user_id='b138098d576745578a45bc4aa67d0262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea84512b-4222-4315-8423-222ebcbca2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea84512b-4222-4315-8423-222ebcbca2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe42983-7454-4ad6-9dd5-ee869d84021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe42983-7454-4ad6-9dd5-ee869d84021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b', 'volume_name': 'volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332f4269-f3b5-4317-bd28-25f8123c1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332f4269-f3b5-4317-bd28-25f8123c1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b59d1b-ccd5-4a03-8bbd-9c26abe6f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:32 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Volume 981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b', 'volume_size': 1} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-191530522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad711df716f499c8c0436d5bb857304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:32Z,use_quota=True,user_id='b138098d576745578a45bc4aa67d0262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Creating volume 981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:32 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:32 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b 1073741824 Jul 20 16:45:32 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:33 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b 1073741824" returned: 0 in 0.628s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:33 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b Jul 20 16:45:33 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:33 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b" returned: 0 in 0.316s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b59d1b-ccd5-4a03-8bbd-9c26abe6f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b5e885-3488-49da-bc27-bdc122b63cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:33 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Volume volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b (981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b): created successfully Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b5e885-3488-49da-bc27-bdc122b63cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Flow 'volume_create_manager' (448dd9c4-1c32-4870-b28f-7e209e9a6e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e4817ef6-8a22-4ece-afac-6a9fee4daf86 tempest-AttachVolumeNegativeTest-1042691458 None] Created volume successfully. Jul 20 16:45:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-deefd943-ce2e-40ba-aeab-257fb3e6317b req-c193bb31-8108-4b7e-a075-70fa191e3b48 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-deefd943-ce2e-40ba-aeab-257fb3e6317b req-c193bb31-8108-4b7e-a075-70fa191e3b48 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-deefd943-ce2e-40ba-aeab-257fb3e6317b req-c193bb31-8108-4b7e-a075-70fa191e3b48 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-deefd943-ce2e-40ba-aeab-257fb3e6317b req-c193bb31-8108-4b7e-a075-70fa191e3b48 tempest-AttachVolumeNegativeTest-1042691458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1774cdb-9ac0-49f9-b219-ab1b0acb66b6', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:45:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-deefd943-ce2e-40ba-aeab-257fb3e6317b req-c193bb31-8108-4b7e-a075-70fa191e3b48 tempest-AttachVolumeNegativeTest-1042691458 None] attachment_update completed successfully. Jul 20 16:45:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6f2d7afb-f774-4a1f-894f-5c6165f6121b tempest-GroupSnapshotsV319Test-1369805679 None] Group tempest-GroupSnapshotsV319Test-Group-2022638760: creating Jul 20 16:45:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6f2d7afb-f774-4a1f-894f-5c6165f6121b tempest-GroupSnapshotsV319Test-1369805679 None] Group tempest-GroupSnapshotsV319Test-Group-2022638760: created successfully Jul 20 16:45:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6f2d7afb-f774-4a1f-894f-5c6165f6121b tempest-GroupSnapshotsV319Test-1369805679 None] Create group completed successfully. Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Flow 'volume_create_manager' (354ffad7-aeba-4257-83ae-6c3acfd46dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7fd129-f174-4c76-9a97-4917a76dd0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7fd129-f174-4c76-9a97-4917a76dd0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091423126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16914737-f503-4556-895e-11983dbb501b,host='devstack@QuobyteHD#QuobyteHD',id=a9cba22b-0462-458a-9139-e3ac08cc69b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8df8880ea2547b28163508743c76b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:38Z,use_quota=True,user_id='463de9d05cec443c81d58b21eb56ff6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9956ea6-9fd0-42ff-8d30-0bd0ed40e62b),volume_type_id=e9956ea6-9fd0-42ff-8d30-0bd0ed40e62b)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d82897f-1fe5-4776-80d4-a8b4e534bf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d82897f-1fe5-4776-80d4-a8b4e534bf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f2dc6-1a42-4344-a884-e6a8ed024f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f2dc6-1a42-4344-a884-e6a8ed024f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9cba22b-0462-458a-9139-e3ac08cc69b8', 'volume_name': 'volume-a9cba22b-0462-458a-9139-e3ac08cc69b8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb15fa7b-e5a4-4b67-920e-ae4b2f0636d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb15fa7b-e5a4-4b67-920e-ae4b2f0636d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8316fe30-0a97-4fe9-a62f-916ece2dd5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:38 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Volume a9cba22b-0462-458a-9139-e3ac08cc69b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9cba22b-0462-458a-9139-e3ac08cc69b8', 'volume_size': 1} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16914737-f503-4556-895e-11983dbb501b,created_at=2026-07-20T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091423126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16914737-f503-4556-895e-11983dbb501b,host='devstack@QuobyteHD#QuobyteHD',id=a9cba22b-0462-458a-9139-e3ac08cc69b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8df8880ea2547b28163508743c76b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:45:38Z,use_quota=True,user_id='463de9d05cec443c81d58b21eb56ff6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9956ea6-9fd0-42ff-8d30-0bd0ed40e62b),volume_type_id=e9956ea6-9fd0-42ff-8d30-0bd0ed40e62b)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Creating volume a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:45:38 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:45:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:38 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 1073741824 Jul 20 16:45:38 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:39 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:39 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:39 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 1073741824" returned: 0 in 0.873s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:39 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 Jul 20 16:45:39 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:39 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.827s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:45:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:45:40 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8" returned: 0 in 0.731s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8316fe30-0a97-4fe9-a62f-916ece2dd5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cba22b-0462-458a-9139-e3ac08cc69b8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919565dd-aef2-4ecd-b3c1-3b96ff8d996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:45:40 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Volume volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 (a9cba22b-0462-458a-9139-e3ac08cc69b8): created successfully Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919565dd-aef2-4ecd-b3c1-3b96ff8d996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:45:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Flow 'volume_create_manager' (354ffad7-aeba-4257-83ae-6c3acfd46dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:45:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-aec46fb0-2140-4349-8220-6fd12d30661e tempest-GroupSnapshotsV319Test-1369805679 None] Created volume successfully. Jul 20 16:45:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] GroupSnapshot 760a5208-8d00-4a34-837e-204b8543df55: creating. Jul 20 16:45:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Group snapshot 760a5208-8d00-4a34-837e-204b8543df55: creating. {{(pid=87535) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 20 16:45:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Creating offline snapshot 29c0f5bc-9408-49cd-a526-12b0a93220d1 of volume a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:45:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfd5b94-40d0-4642-9fd0-558fa8320bf4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:41 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 Jul 20 16:45:41 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:42 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8" returned: 0 in 0.580s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:42 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 1G Jul 20 16:45:42 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:42 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 1G" returned: 0 in 0.590s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:42 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 Jul 20 16:45:42 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:43 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1" returned: 0 in 0.612s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:43 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:45:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:43 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 Jul 20 16:45:43 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:43 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1" returned: 0 in 0.543s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:44 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info Jul 20 16:45:44 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:44 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info" returned: 0 in 0.448s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:44 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:45:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:44 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info Jul 20 16:45:44 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:44 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.info" returned: 0 in 0.458s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.382s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-76d694de-e956-4ab6-a1c6-5e5e9717d57c tempest-GroupSnapshotsV319Test-1369805679 None] group_snapshot 760a5208-8d00-4a34-837e-204b8543df55: created successfully Jul 20 16:45:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] group_snapshot 760a5208-8d00-4a34-837e-204b8543df55: deleting Jul 20 16:45:46 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=90,cinder:UPDATE=108,cinder:INSERT=30,cinder:DELETE=7 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:45:46 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=83,cinder:INSERT=22,cinder:UPDATE=95,cinder:DELETE=11 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:45:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] group_snapshot 760a5208-8d00-4a34-837e-204b8543df55: deleting {{(pid=87535) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 20 16:45:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "cinder-quobyte-a9cba22b-0462-458a-9139-e3ac08cc69b8" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Lock "cinder-quobyte-a9cba22b-0462-458a-9139-e3ac08cc69b8" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "cinder-quobyte-29c0f5bc-9408-49cd-a526-12b0a93220d1" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Lock "cinder-quobyte-29c0f5bc-9408-49cd-a526-12b0a93220d1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Deleting offline snapshot 29c0f5bc-9408-49cd-a526-12b0a93220d1 of volume a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] snapshot_file for this snap is: volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8835f72a-1c23-4563-8ec0-c1b5ebd28c21]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:47 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 Jul 20 16:45:47 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:47 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1" returned: 0 in 0.648s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9cba22b-0462-458a-9139-e3ac08cc69b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e6d33-d519-4cad-b473-2fb8aa0fa523]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:48 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 Jul 20 16:45:48 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:48 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8" returned: 0 in 0.973s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:48 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 Jul 20 16:45:48 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:49 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1" returned: 0 in 0.726s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:49 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1 Jul 20 16:45:49 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:50 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8.29c0f5bc-9408-49cd-a526-12b0a93220d1" returned: 0 in 0.496s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Lock "cinder-quobyte-29c0f5bc-9408-49cd-a526-12b0a93220d1" released by "_delete_snapshot" :: held 3.026s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Lock "cinder-quobyte-a9cba22b-0462-458a-9139-e3ac08cc69b8" released by "delete_snapshot" :: held 3.084s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:50 devstack cinder-volume[87535]: WARNING cinder.quota [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2006257245 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2006257245, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:45:50 devstack cinder-volume[87535]: WARNING cinder.quota [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2006257245 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2006257245, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:45:50 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] Created reservations ['de773641-2b3b-4d02-bf07-8d2af9e5f009', 'dfc1df0c-413a-469e-a593-56731b8ccd8a', 'ed1ed323-a9eb-4a34-92bb-41c0a3f729fd', 'c33921be-92d1-4cdf-8255-cad7b08add34'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:50 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2c19bc71-3d24-4d95-85f7-461dcb3535a1 tempest-GroupSnapshotsV319Test-1369805679 None] group_snapshot 760a5208-8d00-4a34-837e-204b8543df55: deleted successfully Jul 20 16:45:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "cinder-quobyte-a9cba22b-0462-458a-9139-e3ac08cc69b8" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:45:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "cinder-quobyte-a9cba22b-0462-458a-9139-e3ac08cc69b8" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:45:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ebd931-fccc-480f-8d61-7c3826bf5aff]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:45:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:51 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 Jul 20 16:45:51 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:51 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8" returned: 0 in 0.578s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:51 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8 Jul 20 16:45:51 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:52 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a9cba22b-0462-458a-9139-e3ac08cc69b8" returned: 0 in 0.576s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "cinder-quobyte-a9cba22b-0462-458a-9139-e3ac08cc69b8" released by "delete_volume" :: held 1.267s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Created reservations ['c8cc2614-b460-4d91-95e7-1beb08dd103d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:52 devstack cinder-volume[87535]: WARNING cinder.quota [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2006257245 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2006257245, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Created reservations ['e752029e-7aa2-478a-aec8-65c7fcf52365', '45dfb054-bb0c-4c4c-9747-014998360fe1', '6daa1a57-9d07-4910-943b-cda2a113891a', '801bb429-82fc-4840-83f6-7333521ac0d7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:45:52 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:45:52 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:45:52 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.271s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:45:52 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:45:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-43cfc864-5013-4899-93e0-fc547685364e tempest-GroupSnapshotsV319Test-1369805679 None] Delete group completed successfully. Jul 20 16:46:02 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:46:02 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=14,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:46:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e55a5402-1e22-427e-b8c6-0aa8bdbdff2d tempest-GroupsV320Test-2009567162 None] Group tempest-GroupsV320Test-Group-280680200: creating Jul 20 16:46:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e55a5402-1e22-427e-b8c6-0aa8bdbdff2d tempest-GroupsV320Test-2009567162 None] Group tempest-GroupsV320Test-Group-280680200: created successfully Jul 20 16:46:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e55a5402-1e22-427e-b8c6-0aa8bdbdff2d tempest-GroupsV320Test-2009567162 None] Create group completed successfully. Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Created reservations ['88e4d00d-19d4-4ab5-a6b0-dfe023a1eb65'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:05 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:46:05 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:05 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.437s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:05 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:46:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-eab21bc8-56ed-4fe7-b3d8-4e7fa859e8cd tempest-GroupsV320Test-2009567162 None] Delete group completed successfully. Jul 20 16:46:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c52dba66-80df-406d-a5ca-a6366cdca1a9 req-46d3fd98-369d-470a-8225-5abe91a3a515 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c52dba66-80df-406d-a5ca-a6366cdca1a9 req-46d3fd98-369d-470a-8225-5abe91a3a515 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c52dba66-80df-406d-a5ca-a6366cdca1a9 req-46d3fd98-369d-470a-8225-5abe91a3a515 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-c52dba66-80df-406d-a5ca-a6366cdca1a9 req-46d3fd98-369d-470a-8225-5abe91a3a515 tempest-TestInstancesWithCinderVolumes-2014490119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f5b890c-7d7c-4f36-89b7-151e20a8dba1', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:46:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-c52dba66-80df-406d-a5ca-a6366cdca1a9 req-46d3fd98-369d-470a-8225-5abe91a3a515 tempest-TestInstancesWithCinderVolumes-2014490119 None] attachment_update completed successfully. Jul 20 16:46:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-29a704cf-9544-4b7c-bf46-120d30fc9e2d req-8ba272e8-0900-448b-896a-43ec96be1a51 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-29a704cf-9544-4b7c-bf46-120d30fc9e2d req-8ba272e8-0900-448b-896a-43ec96be1a51 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-29a704cf-9544-4b7c-bf46-120d30fc9e2d req-8ba272e8-0900-448b-896a-43ec96be1a51 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-29a704cf-9544-4b7c-bf46-120d30fc9e2d req-8ba272e8-0900-448b-896a-43ec96be1a51 tempest-TestInstancesWithCinderVolumes-2014490119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-353de5cd-a30a-40fd-a497-f9ceede8f797', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb951239-a6ae-47fd-817f-896ed1a9051a', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:46:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-29a704cf-9544-4b7c-bf46-120d30fc9e2d req-8ba272e8-0900-448b-896a-43ec96be1a51 tempest-TestInstancesWithCinderVolumes-2014490119 None] attachment_update completed successfully. Jul 20 16:46:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-a9a929d6-f43b-4c5e-8d00-cf314487ab4f req-8c280719-7239-4387-944b-7c1c20c453df tempest-TestInstancesWithCinderVolumes-2014490119 None] Terminate volume connection completed successfully. Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-a9a929d6-f43b-4c5e-8d00-cf314487ab4f req-8c280719-7239-4387-944b-7c1c20c453df tempest-TestInstancesWithCinderVolumes-2014490119 None] Deleting attachment 9f5b890c-7d7c-4f36-89b7-151e20a8dba1. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "cinder-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "cinder-quobyte-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-quobyte-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e3ded-72bb-4599-b162-6495f6a849d7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:46:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:19 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 Jul 20 16:46:19 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:19 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0" returned: 0 in 0.469s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:19 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0 Jul 20 16:46:19 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:19 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-quobyte-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0" released by "delete_volume" :: held 0.919s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:19 devstack cinder-volume[87535]: WARNING cinder.quota [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163946414-1565436190 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163946414-1565436190, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:46:19 devstack cinder-volume[87535]: WARNING cinder.quota [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163946414-1565436190 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1163946414-1565436190, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:46:19 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Created reservations ['76daa33e-24db-473a-8d74-acb20c681e3d', '3197e628-5039-4cac-8958-bd8695a4f64c', '7217b9f0-42f3-43fc-bb4e-0fd1a495a7fd', 'feea2c2d-89ff-4c47-ae9f-3bb60c71798b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:20 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:46:20 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:20 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:46:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Deleted volume successfully. Jul 20 16:46:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfe54828-c99b-41d0-bf7b-cbd08cdac59c tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-e9fbceb4-2ef4-4a52-bdb4-142f1994d2b0-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-ae3280e4-9466-4805-ae4d-4582ae3553d8 req-69544794-11c7-4e1c-bb6c-863a4f1bf4a3 tempest-TestInstancesWithCinderVolumes-2014490119 None] Terminate volume connection completed successfully. Jul 20 16:46:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-ae3280e4-9466-4805-ae4d-4582ae3553d8 req-69544794-11c7-4e1c-bb6c-863a4f1bf4a3 tempest-TestInstancesWithCinderVolumes-2014490119 None] Deleting attachment bb951239-a6ae-47fd-817f-896ed1a9051a. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Flow 'volume_create_manager' (e1573fe8-e46c-4849-94dd-99a79b01f842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4702c254-3da4-4809-9d69-34cabc41cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4702c254-3da4-4809-9d69-34cabc41cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2058797047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f899523-5483-4112-a38b-8daf5f12e550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23fed44829c94b2b97cb5c2f5c8a8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:46:23Z,use_quota=True,user_id='d16085d1802e48e5b21e183fb367bf5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff9389b-8b80-49c3-b801-c96b1a7db676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff9389b-8b80-49c3-b801-c96b1a7db676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73b17bf-ac2a-48d4-b1f6-15f3bd0d31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73b17bf-ac2a-48d4-b1f6-15f3bd0d31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f899523-5483-4112-a38b-8daf5f12e550', 'volume_name': 'volume-6f899523-5483-4112-a38b-8daf5f12e550', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2a2add-4ab4-40b1-adf0-3126066f189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2a2add-4ab4-40b1-adf0-3126066f189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7717fe4-6b02-4648-83f0-0cb10c1aa8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:23 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Volume 6f899523-5483-4112-a38b-8daf5f12e550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f899523-5483-4112-a38b-8daf5f12e550', 'volume_size': 1} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2058797047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f899523-5483-4112-a38b-8daf5f12e550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23fed44829c94b2b97cb5c2f5c8a8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:46:23Z,use_quota=True,user_id='d16085d1802e48e5b21e183fb367bf5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Creating volume 6f899523-5483-4112-a38b-8daf5f12e550 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:46:23 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:23 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 1073741824 Jul 20 16:46:23 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "cinder-353de5cd-a30a-40fd-a497-f9ceede8f797-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-353de5cd-a30a-40fd-a497-f9ceede8f797-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "cinder-quobyte-353de5cd-a30a-40fd-a497-f9ceede8f797" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-quobyte-353de5cd-a30a-40fd-a497-f9ceede8f797" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e443f3c0-658a-4d3e-865c-030a58b86813]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:23 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 1073741824" returned: 0 in 0.483s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:23 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 Jul 20 16:46:23 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:23 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 Jul 20 16:46:23 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:24 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797" returned: 0 in 0.491s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:24 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550" returned: 0 in 0.415s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:24 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797 Jul 20 16:46:24 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7717fe4-6b02-4648-83f0-0cb10c1aa8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f899523-5483-4112-a38b-8daf5f12e550', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6853a341-8da6-41be-acb5-e2f3f44e357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:24 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Volume volume-6f899523-5483-4112-a38b-8daf5f12e550 (6f899523-5483-4112-a38b-8daf5f12e550): created successfully Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6853a341-8da6-41be-acb5-e2f3f44e357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Flow 'volume_create_manager' (e1573fe8-e46c-4849-94dd-99a79b01f842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:46:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f8dbc7ae-6749-4420-938f-3ab897d63394 tempest-VolumesServicesTestJSON-850881056 None] Created volume successfully. Jul 20 16:46:24 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-353de5cd-a30a-40fd-a497-f9ceede8f797" returned: 0 in 0.306s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-quobyte-353de5cd-a30a-40fd-a497-f9ceede8f797" released by "delete_volume" :: held 0.863s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:24 devstack cinder-volume[87535]: WARNING cinder.quota [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030570500-1690786335 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030570500-1690786335, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:46:24 devstack cinder-volume[87535]: WARNING cinder.quota [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030570500-1690786335 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1030570500-1690786335, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Created reservations ['cd8caaca-787b-435c-a09a-162b3c034800', 'a971e653-1635-49cf-bc37-e1c817716c38', 'dfee5ecc-52a4-49d5-8ca1-54c6130f977c', '51e0acd8-db6d-48d7-a816-282d09ee3f0a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:24 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:46:24 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:25 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.353s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:46:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Deleted volume successfully. Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a16ed31-fe73-48dc-a68a-0bba3b21ef29 tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-353de5cd-a30a-40fd-a497-f9ceede8f797-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Acquiring lock "cinder-6f899523-5483-4112-a38b-8daf5f12e550-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Lock "cinder-6f899523-5483-4112-a38b-8daf5f12e550-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Acquiring lock "cinder-quobyte-6f899523-5483-4112-a38b-8daf5f12e550" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Lock "cinder-quobyte-6f899523-5483-4112-a38b-8daf5f12e550" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8153a-cc44-4c5c-b573-ffae013b3404]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:46:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:25 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 Jul 20 16:46:25 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:26 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550" returned: 0 in 0.532s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:26 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550 Jul 20 16:46:26 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:26 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6f899523-5483-4112-a38b-8daf5f12e550" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Lock "cinder-quobyte-6f899523-5483-4112-a38b-8daf5f12e550" released by "delete_volume" :: held 0.978s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Created reservations ['0dc69441-2e64-417e-8ce0-962ed8ff64ef', 'e4a32563-6fee-4b99-b15d-962081b4187d', '1d29cd0f-b0b8-41d8-ab38-bdfd4579a984', 'd846268d-0c70-4567-baa9-fb47fef4b45c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:26 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:46:26 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:27 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.500s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:27 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:46:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Deleted volume successfully. Jul 20 16:46:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ed2f08-2769-4734-933d-b9ed726e58a3 tempest-VolumesServicesTestJSON-850881056 None] Lock "cinder-6f899523-5483-4112-a38b-8daf5f12e550-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-1a0eb1a7-a00c-41c2-b43c-4b6ad0f0c397 req-d95b79bf-70d1-4bda-9680-eade3647d450 tempest-TestInstancesWithCinderVolumes-2014490119 None] Terminate volume connection completed successfully. Jul 20 16:46:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-1a0eb1a7-a00c-41c2-b43c-4b6ad0f0c397 req-d95b79bf-70d1-4bda-9680-eade3647d450 tempest-TestInstancesWithCinderVolumes-2014490119 None] Deleting attachment 4b5ed796-765d-4679-9707-97ee97246212. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:46:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-5d07313b-115b-4029-9d41-f0f2e2f5e7eb req-144efe2a-74f5-4805-9ad5-4ec5819de7dd tempest-AttachVolumeNegativeTest-1042691458 None] Terminate volume connection completed successfully. Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-5d07313b-115b-4029-9d41-f0f2e2f5e7eb req-144efe2a-74f5-4805-9ad5-4ec5819de7dd tempest-AttachVolumeNegativeTest-1042691458 None] Deleting attachment e1774cdb-9ac0-49f9-b219-ab1b0acb66b6. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Flow 'volume_create_manager' (6677fb17-4f6d-4946-ad3a-a9345632839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e2ef4a-266a-4b9b-9c2b-f62f57d25a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e2ef4a-266a-4b9b-9c2b-f62f57d25a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-438430043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a31b250d0749e9839bb4ddd9766472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:46:30Z,use_quota=True,user_id='aa10b3eb6fda4cc193db618c389ff79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7964c9dd-6869-49c8-8b82-4b515036f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7964c9dd-6869-49c8-8b82-4b515036f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac84200d-1192-4296-83a5-21c559e21114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac84200d-1192-4296-83a5-21c559e21114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e', 'volume_name': 'volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3bf7c9-0f58-4b28-b028-13b3a7556dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3bf7c9-0f58-4b28-b028-13b3a7556dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ab46c6-f2ee-45e6-884f-9e8471e6dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Volume ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e', 'volume_size': 1} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-438430043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a31b250d0749e9839bb4ddd9766472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:46:30Z,use_quota=True,user_id='aa10b3eb6fda4cc193db618c389ff79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Creating volume ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:46:30 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:30 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e 1073741824 Jul 20 16:46:30 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "cinder-95f8918b-baa4-4503-8b35-29728e745b71-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-95f8918b-baa4-4503-8b35-29728e745b71-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "cinder-quobyte-95f8918b-baa4-4503-8b35-29728e745b71" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:46:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-quobyte-95f8918b-baa4-4503-8b35-29728e745b71" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a19358-67ec-4d32-911d-1771dd89c03e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:46:31 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e 1073741824" returned: 0 in 0.601s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:31 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e Jul 20 16:46:31 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:31 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 Jul 20 16:46:31 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:31 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e" returned: 0 in 0.380s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ab46c6-f2ee-45e6-884f-9e8471e6dd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdce0ed-c654-4712-bf3e-76a1a67b3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:46:31 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Volume volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e (ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e): created successfully Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdce0ed-c654-4712-bf3e-76a1a67b3a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Flow 'volume_create_manager' (6677fb17-4f6d-4946-ad3a-a9345632839c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:46:31 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71" returned: 0 in 0.692s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-18cbbfba-eb2d-4191-bb37-8f9436c7f5b9 tempest-AttachVolumeShelveTestJSON-1059492282 None] Created volume successfully. Jul 20 16:46:31 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71 Jul 20 16:46:31 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:32 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95f8918b-baa4-4503-8b35-29728e745b71" returned: 0 in 0.339s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-quobyte-95f8918b-baa4-4503-8b35-29728e745b71" released by "delete_volume" :: held 1.092s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:32 devstack cinder-volume[87535]: WARNING cinder.quota [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1006293225-530551651 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1006293225-530551651, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:46:32 devstack cinder-volume[87535]: WARNING cinder.quota [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1006293225-530551651 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1006293225-530551651, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Created reservations ['8ffe4aa3-e3f8-4cbf-8f1c-0111c5051534', 'db48dc05-6c0e-43af-adcb-8e7a3a75faa6', '69429d83-970e-4282-8ad4-0f30c2b5e095', '3c48c03d-1ef8-48a7-833c-e4b28ba23983'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:32 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:46:32 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:32 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.309s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:46:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Deleted volume successfully. Jul 20 16:46:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6a4785e6-7b90-48ad-a7dd-65b948482daa tempest-TestInstancesWithCinderVolumes-2014490119 None] Lock "cinder-95f8918b-baa4-4503-8b35-29728e745b71-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:46:39 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:46:39 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:46:39 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:46:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:46:42 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=49,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:46:42 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=46,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:46:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-41b28ced-b8a7-44fc-b23c-eb1eef7668d0 req-5547a123-b52a-4622-ab64-cf9443b5dea0 tempest-AttachVolumeShelveTestJSON-1059492282 None] No connector for attachment f0bd9c76-cfbe-4ee1-a883-f20873d251be; skipping storage backend terminate_connection call. {{(pid=87535) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 20 16:46:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-41b28ced-b8a7-44fc-b23c-eb1eef7668d0 req-5547a123-b52a-4622-ab64-cf9443b5dea0 tempest-AttachVolumeShelveTestJSON-1059492282 None] Deleting attachment f0bd9c76-cfbe-4ee1-a883-f20873d251be. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:47:01 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:47:01 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (49348cf6-35b1-4422-9b6f-35ea0a4c620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c52a04-2c84-4934-a3c9-984e9b22d8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c52a04-2c84-4934-a3c9-984e9b22d8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2081184485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:15Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cffb28-51c0-4d51-975d-e3fc9939690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cffb28-51c0-4d51-975d-e3fc9939690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314d617a-50af-4140-a165-074d5b29ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314d617a-50af-4140-a165-074d5b29ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d', 'volume_name': 'volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d4eb40-1889-414d-8aa8-1d1e72a70e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d4eb40-1889-414d-8aa8-1d1e72a70e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bbce3e-183d-4006-b635-1d1405984291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Volume e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d', 'volume_size': 1} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2081184485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:15Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Creating volume e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:14 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:14 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d 1073741824 Jul 20 16:47:14 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:15 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d 1073741824" returned: 0 in 0.634s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:15 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d Jul 20 16:47:15 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:15 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bbce3e-183d-4006-b635-1d1405984291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d6d399-3d7e-4616-be5c-1a98b2d68cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Volume volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d (e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d): created successfully Jul 20 16:47:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d6d399-3d7e-4616-be5c-1a98b2d68cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (49348cf6-35b1-4422-9b6f-35ea0a4c620c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-76fa38ce-3424-49b8-97f2-bf6d4590dfa1 tempest-VolumesActionsTest-1500041683 None] Created volume successfully. Jul 20 16:47:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-12406c95-64c2-4b5c-bd32-5b6f9cdb17cb tempest-VolumesActionsTest-1500041683 None] Acquiring lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" by "attach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-12406c95-64c2-4b5c-bd32-5b6f9cdb17cb tempest-VolumesActionsTest-1500041683 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" acquired by "attach_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-12406c95-64c2-4b5c-bd32-5b6f9cdb17cb tempest-VolumesActionsTest-1500041683 None] Attaching volume e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d to instance 9a0fcf47-1615-4ba8-8a91-4a28cdca6cb9 at mountpoint /dev/vdb on host None. Jul 20 16:47:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-12406c95-64c2-4b5c-bd32-5b6f9cdb17cb tempest-VolumesActionsTest-1500041683 None] Attach volume completed successfully. Jul 20 16:47:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-12406c95-64c2-4b5c-bd32-5b6f9cdb17cb tempest-VolumesActionsTest-1500041683 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" released by "attach_volume" :: held 0.186s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-81b93b7a-20c1-4499-a885-71d364d716e9 tempest-VolumesActionsTest-2010831024 None] Terminate volume connection completed successfully. Jul 20 16:47:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-81b93b7a-20c1-4499-a885-71d364d716e9 tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-detach_volume" by "detach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-81b93b7a-20c1-4499-a885-71d364d716e9 tempest-VolumesActionsTest-2010831024 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-81b93b7a-20c1-4499-a885-71d364d716e9 tempest-VolumesActionsTest-2010831024 None] Detaching volume e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d from instance 9a0fcf47-1615-4ba8-8a91-4a28cdca6cb9. Jul 20 16:47:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-81b93b7a-20c1-4499-a885-71d364d716e9 tempest-VolumesActionsTest-2010831024 None] Detach volume completed successfully. Jul 20 16:47:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-81b93b7a-20c1-4499-a885-71d364d716e9 tempest-VolumesActionsTest-2010831024 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-detach_volume" released by "detach_volume" :: held 0.263s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3cef6bd4-e73f-40ac-905e-d483830560f1 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-detach_volume" by "detach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3cef6bd4-e73f-40ac-905e-d483830560f1 tempest-VolumesActionsTest-1500041683 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3cef6bd4-e73f-40ac-905e-d483830560f1 tempest-VolumesActionsTest-1500041683 None] Volume detach called, but volume not attached. Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3cef6bd4-e73f-40ac-905e-d483830560f1 tempest-VolumesActionsTest-1500041683 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "cinder-quobyte-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Lock "cinder-quobyte-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" acquired by "delete_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8784e0-1d30-4a84-965c-05446d37a550]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:21 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d Jul 20 16:47:21 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:21 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" returned: 0 in 0.520s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:21 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d Jul 20 16:47:21 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:21 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" returned: 0 in 0.497s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Lock "cinder-quobyte-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d" released by "delete_volume" :: held 1.107s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Created reservations ['e1a566e6-7dc8-4071-a0a7-f35b1ea8df12', '463b8db4-226f-46ca-b7d2-47c3caf9e92a', '164e053b-e5f4-4084-a985-cb7e6dcefccc', 'e4dbc0d5-2258-4bbe-a934-c38029b6a6c3'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:22 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:22 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:22 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.370s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Deleted volume successfully. Jul 20 16:47:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-402c8c92-211e-4fbc-8999-004036f83255 tempest-VolumesActionsTest-1500041683 None] Lock "cinder-e95e7f1c-9917-42e4-a6d3-399e9ea5ac7d-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Flow 'volume_create_manager' (3c1f33fe-290c-47b6-9d02-b96117de55f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab593330-a2a8-4b27-822f-890e1c820b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab593330-a2a8-4b27-822f-890e1c820b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1448087353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fcb151-68fc-4915-a646-b4904b521a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad711df716f499c8c0436d5bb857304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:25Z,use_quota=True,user_id='b138098d576745578a45bc4aa67d0262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a8c989-998f-4eb6-9650-d93642f58d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a8c989-998f-4eb6-9650-d93642f58d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53960090-9529-4ac2-a399-fbe50df442a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53960090-9529-4ac2-a399-fbe50df442a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fcb151-68fc-4915-a646-b4904b521a2b', 'volume_name': 'volume-e3fcb151-68fc-4915-a646-b4904b521a2b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b83f13-e04b-4554-b1d9-eed6e91b312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b83f13-e04b-4554-b1d9-eed6e91b312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49de891-c4ee-4539-967d-724d2d4602de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:24 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Volume e3fcb151-68fc-4915-a646-b4904b521a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fcb151-68fc-4915-a646-b4904b521a2b', 'volume_size': 1} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1448087353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fcb151-68fc-4915-a646-b4904b521a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad711df716f499c8c0436d5bb857304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:25Z,use_quota=True,user_id='b138098d576745578a45bc4aa67d0262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Creating volume e3fcb151-68fc-4915-a646-b4904b521a2b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:24 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:24 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b 1073741824 Jul 20 16:47:24 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:25 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b 1073741824" returned: 0 in 0.726s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:25 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b Jul 20 16:47:25 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:26 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b" returned: 0 in 0.383s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49de891-c4ee-4539-967d-724d2d4602de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fcb151-68fc-4915-a646-b4904b521a2b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f657c964-c57f-435e-a686-ceea573500bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:26 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Volume volume-e3fcb151-68fc-4915-a646-b4904b521a2b (e3fcb151-68fc-4915-a646-b4904b521a2b): created successfully Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f657c964-c57f-435e-a686-ceea573500bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Flow 'volume_create_manager' (3c1f33fe-290c-47b6-9d02-b96117de55f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:26 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-471721b7-3e70-49a2-b676-633fbbd23d1e tempest-AttachVolumeNegativeTest-1042691458 None] Created volume successfully. Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (732f2074-a3dd-4f10-88ce-a5998cca54c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ca2353-132d-465e-8878-c5c957ae5b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ca2353-132d-465e-8878-c5c957ae5b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-613868279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:27Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df310cac-ee73-41fd-86f5-50901067a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df310cac-ee73-41fd-86f5-50901067a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0ecd35-2073-4727-a7c6-ea433ff56b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0ecd35-2073-4727-a7c6-ea433ff56b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6', 'volume_name': 'volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa25a8e-faba-449e-acda-70ed17a40607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa25a8e-faba-449e-acda-70ed17a40607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80ce1cf-b775-4194-bdfd-8845fb057198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:27 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Volume a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6', 'volume_size': 1} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-613868279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:27Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Creating volume a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:27 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:27 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 1073741824 Jul 20 16:47:27 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-865365c4-a4b9-46d6-accc-febc0e380525 req-d5877417-c1e8-49d3-adbf-527f74563692 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:28 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 1073741824" returned: 0 in 0.754s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:28 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 Jul 20 16:47:28 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:28 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6" returned: 0 in 0.309s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-865365c4-a4b9-46d6-accc-febc0e380525 req-d5877417-c1e8-49d3-adbf-527f74563692 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.530s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-865365c4-a4b9-46d6-accc-febc0e380525 req-d5877417-c1e8-49d3-adbf-527f74563692 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80ce1cf-b775-4194-bdfd-8845fb057198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4b820d-ebcd-4ae4-8561-65f583c196a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Volume volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 (a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6): created successfully Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4b820d-ebcd-4ae4-8561-65f583c196a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (732f2074-a3dd-4f10-88ce-a5998cca54c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-faab5c15-ab02-4e74-a0e8-baa88f9acf1b tempest-VolumesActionsTest-1500041683 None] Created volume successfully. Jul 20 16:47:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-865365c4-a4b9-46d6-accc-febc0e380525 req-d5877417-c1e8-49d3-adbf-527f74563692 tempest-AttachVolumeNegativeTest-1042691458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-e3fcb151-68fc-4915-a646-b4904b521a2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '599afd44-1f31-4dc0-80c5-464a762261cc', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:47:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-865365c4-a4b9-46d6-accc-febc0e380525 req-d5877417-c1e8-49d3-adbf-527f74563692 tempest-AttachVolumeNegativeTest-1042691458 None] attachment_update completed successfully. Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Flow 'volume_create_manager' (63d641b1-fbc5-4c95-8147-373b2887cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12a0317-811f-4c18-b2d0-65ae498740fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12a0317-811f-4c18-b2d0-65ae498740fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2089567687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4364f5a8-3237-46b2-9b4b-2df4285b31d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdddd632274d8ab2518e684970716a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:29Z,use_quota=True,user_id='d5c100d2e99a4eebae824853ffae3095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a465f3c-c183-4dcb-b2e6-1bb08098430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a465f3c-c183-4dcb-b2e6-1bb08098430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd609cb-eb61-427c-a992-cbaff2c59be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd609cb-eb61-427c-a992-cbaff2c59be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4364f5a8-3237-46b2-9b4b-2df4285b31d9', 'volume_name': 'volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed7c7cb-757b-4ca1-9f12-7dcdbe0aad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed7c7cb-757b-4ca1-9f12-7dcdbe0aad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bfd2eb-e5af-4b9d-9788-835145484417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Volume 4364f5a8-3237-46b2-9b4b-2df4285b31d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9', 'volume_size': 1} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2089567687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4364f5a8-3237-46b2-9b4b-2df4285b31d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdddd632274d8ab2518e684970716a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:29Z,use_quota=True,user_id='d5c100d2e99a4eebae824853ffae3095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Creating volume 4364f5a8-3237-46b2-9b4b-2df4285b31d9 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:29 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6-delete_volume" acquired by "delete_volume" :: waited 0.260s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:29 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 1073741824 Jul 20 16:47:29 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-quobyte-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6" acquired by "delete_volume" :: waited 0.041s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7050fe37-4661-40c4-923b-3d2d8a518f1d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Flow 'volume_create_manager' (8cd12441-88a2-4539-be34-ecbfdf04fe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:30 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 Jul 20 16:47:30 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc35c34d-80b8-4c69-ae09-a2a2e8abf078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc35c34d-80b8-4c69-ae09-a2a2e8abf078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1450728854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc83db-0b94-461b-9e3d-ac77b840b44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdddd632274d8ab2518e684970716a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:30Z,use_quota=True,user_id='d5c100d2e99a4eebae824853ffae3095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cb4120-1104-473e-a704-8811926198c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cb4120-1104-473e-a704-8811926198c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4a00d5-7266-4067-b6ae-748ea8ff6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4a00d5-7266-4067-b6ae-748ea8ff6541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58dc83db-0b94-461b-9e3d-ac77b840b44c', 'volume_name': 'volume-58dc83db-0b94-461b-9e3d-ac77b840b44c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef85817f-0ad9-4216-a1a3-4cc04b05490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef85817f-0ad9-4216-a1a3-4cc04b05490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3073a2f0-bd2a-4efe-84f2-1d50eb582e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Volume 58dc83db-0b94-461b-9e3d-ac77b840b44c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58dc83db-0b94-461b-9e3d-ac77b840b44c', 'volume_size': 1} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:30 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 1073741824" returned: 0 in 0.829s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:30 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 Jul 20 16:47:30 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:30 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6" returned: 0 in 0.713s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:30 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6 Jul 20 16:47:30 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:30 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9" returned: 0 in 0.292s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1450728854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc83db-0b94-461b-9e3d-ac77b840b44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdddd632274d8ab2518e684970716a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:30Z,use_quota=True,user_id='d5c100d2e99a4eebae824853ffae3095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Creating volume 58dc83db-0b94-461b-9e3d-ac77b840b44c {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:30 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4bfd2eb-e5af-4b9d-9788-835145484417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:31 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c 1073741824 Jul 20 16:47:31 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cf8a19-a6b9-49f1-bab1-eb64cd6dc061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:31 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Volume volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 (4364f5a8-3237-46b2-9b4b-2df4285b31d9): created successfully Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cf8a19-a6b9-49f1-bab1-eb64cd6dc061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Flow 'volume_create_manager' (63d641b1-fbc5-4c95-8147-373b2887cecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e842192c-769e-46d6-9f1e-f87635f08f39 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Created volume successfully. Jul 20 16:47:31 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6" returned: 0 in 0.454s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6" released by "delete_volume" :: held 1.265s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Created reservations ['58ab6458-a94d-47a1-a83c-16765da24bde', '4fdebc0d-bb77-4b72-be00-fdae9647f88b', 'a1fd2375-34c0-4cf5-b9b0-2a64c529ee28', '56cc6c45-9122-4cc2-b6d6-d67bfc0bb9b8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:31 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:31 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:31 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c 1073741824" returned: 0 in 0.736s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:31 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c Jul 20 16:47:31 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:32 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.647s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Deleted volume successfully. Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f47f7b06-ddef-4f85-bb22-c520968b2a9a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-a0e9ff14-7a9b-4cb9-9805-e6c2c027d4f6-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:32 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c" returned: 0 in 0.587s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3073a2f0-bd2a-4efe-84f2-1d50eb582e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dc83db-0b94-461b-9e3d-ac77b840b44c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fba8ffc-ba7f-4044-be1a-401f3bf3525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:32 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Volume volume-58dc83db-0b94-461b-9e3d-ac77b840b44c (58dc83db-0b94-461b-9e3d-ac77b840b44c): created successfully Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fba8ffc-ba7f-4044-be1a-401f3bf3525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Flow 'volume_create_manager' (8cd12441-88a2-4539-be34-ecbfdf04fe83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-72c36355-8001-4fa2-9649-e78c8f7477d5 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Created volume successfully. Jul 20 16:47:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-07c5cf6c-d747-4f4b-a63a-0100ff7ce32e req-acccd529-e15a-4292-a15e-57e8c014cad2 tempest-AttachVolumeNegativeTest-1042691458 None] Terminate volume connection completed successfully. Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-07c5cf6c-d747-4f4b-a63a-0100ff7ce32e req-acccd529-e15a-4292-a15e-57e8c014cad2 tempest-AttachVolumeNegativeTest-1042691458 None] Deleting attachment 599afd44-1f31-4dc0-80c5-464a762261cc. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (cf01248e-cf4d-467e-b4bc-43f0e887d561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5bf97f-d301-4b47-bc25-4c9c2482f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5bf97f-d301-4b47-bc25-4c9c2482f42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-810565601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fb641f-3e57-4dc3-a318-4beb08db951e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:33Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e92bfa-203e-4b94-9f7b-fe124f690858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e92bfa-203e-4b94-9f7b-fe124f690858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00aaad82-ee6e-40ec-be2b-c9a31e564443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00aaad82-ee6e-40ec-be2b-c9a31e564443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fb641f-3e57-4dc3-a318-4beb08db951e', 'volume_name': 'volume-67fb641f-3e57-4dc3-a318-4beb08db951e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982f3f3a-8cac-495f-978e-412ffa3595c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982f3f3a-8cac-495f-978e-412ffa3595c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1a823e-642e-4262-b189-0288560b1e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:32 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Volume 67fb641f-3e57-4dc3-a318-4beb08db951e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fb641f-3e57-4dc3-a318-4beb08db951e', 'volume_size': 1} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-810565601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fb641f-3e57-4dc3-a318-4beb08db951e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:33Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Creating volume 67fb641f-3e57-4dc3-a318-4beb08db951e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:32 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:32 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e 1073741824 Jul 20 16:47:32 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:33 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e 1073741824" returned: 0 in 0.543s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:33 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e Jul 20 16:47:33 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:33 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1a823e-642e-4262-b189-0288560b1e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fb641f-3e57-4dc3-a318-4beb08db951e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffb7bf4-3c4b-4c40-8e3a-1794cc4f9b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:33 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Volume volume-67fb641f-3e57-4dc3-a318-4beb08db951e (67fb641f-3e57-4dc3-a318-4beb08db951e): created successfully Jul 20 16:47:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffb7bf4-3c4b-4c40-8e3a-1794cc4f9b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (cf01248e-cf4d-467e-b4bc-43f0e887d561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-de16a71a-9791-4813-9055-9cb4ba887125 tempest-VolumesActionsTest-1500041683 None] Created volume successfully. Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-67fb641f-3e57-4dc3-a318-4beb08db951e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-67fb641f-3e57-4dc3-a318-4beb08db951e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-quobyte-67fb641f-3e57-4dc3-a318-4beb08db951e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-67fb641f-3e57-4dc3-a318-4beb08db951e" acquired by "delete_volume" :: waited 0.077s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f55817-28eb-40cc-877a-327935843666]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:35 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e Jul 20 16:47:35 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:35 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e" returned: 0 in 0.614s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:35 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e Jul 20 16:47:35 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:36 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67fb641f-3e57-4dc3-a318-4beb08db951e" returned: 0 in 0.371s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-67fb641f-3e57-4dc3-a318-4beb08db951e" released by "delete_volume" :: held 1.075s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Created reservations ['b49ad0a2-b9fa-450a-b0b3-98f8e4b81554', '1700cb6d-03d4-4769-b5d7-20eac7ce40bb', '9668808b-9955-4fb8-80f0-6d7d05d10209', '25c1bf21-c35a-4278-b7ac-80512f088206'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:36 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:36 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:36 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Deleted volume successfully. Jul 20 16:47:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e847d80-53be-4d27-8c4f-ff3b1fa3a81a tempest-VolumesActionsTest-2010831024 None] Lock "cinder-67fb641f-3e57-4dc3-a318-4beb08db951e-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (1c80445c-756a-4640-9082-7a4fe7e2b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748ee37c-9950-4aa0-b903-133686dd4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748ee37c-9950-4aa0-b903-133686dd4403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-195189322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b80662-7018-4e62-9c86-048349d11594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:38Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7f2b5d-916f-4933-9790-aeaf521b93fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7f2b5d-916f-4933-9790-aeaf521b93fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ab8452-607b-4bb1-9af5-6b69e55fc734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ab8452-607b-4bb1-9af5-6b69e55fc734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b80662-7018-4e62-9c86-048349d11594', 'volume_name': 'volume-23b80662-7018-4e62-9c86-048349d11594', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01054f3-8bb8-4217-807c-1167708a62ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01054f3-8bb8-4217-807c-1167708a62ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d8fa67-0909-40d9-afc7-1ff84d244c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:38 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Volume 23b80662-7018-4e62-9c86-048349d11594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b80662-7018-4e62-9c86-048349d11594', 'volume_size': 1} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-195189322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b80662-7018-4e62-9c86-048349d11594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:38Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Creating volume 23b80662-7018-4e62-9c86-048349d11594 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:38 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:38 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 1073741824 Jul 20 16:47:38 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:38 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 1073741824" returned: 0 in 0.750s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:39 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 Jul 20 16:47:39 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:39 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:39 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:39 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594" returned: 0 in 0.434s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d8fa67-0909-40d9-afc7-1ff84d244c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b80662-7018-4e62-9c86-048349d11594', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b226b2f-97ce-4876-87f0-6080009032f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:39 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Volume volume-23b80662-7018-4e62-9c86-048349d11594 (23b80662-7018-4e62-9c86-048349d11594): created successfully Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b226b2f-97ce-4876-87f0-6080009032f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (1c80445c-756a-4640-9082-7a4fe7e2b73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ba06e452-1dec-4bf8-bd07-d8a4140eed3e tempest-VolumesActionsTest-1500041683 None] Created volume successfully. Jul 20 16:47:39 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:47:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:47:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-23b80662-7018-4e62-9c86-048349d11594-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Lock "cinder-23b80662-7018-4e62-9c86-048349d11594-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-quobyte-23b80662-7018-4e62-9c86-048349d11594" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-23b80662-7018-4e62-9c86-048349d11594" acquired by "delete_volume" :: waited 0.056s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:40 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[43afe973-10ea-4d8e-a2ce-f045786b8597]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:41 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 Jul 20 16:47:41 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:41 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594" returned: 0 in 0.778s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:41 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594 Jul 20 16:47:41 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:42 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-23b80662-7018-4e62-9c86-048349d11594" returned: 0 in 0.374s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-23b80662-7018-4e62-9c86-048349d11594" released by "delete_volume" :: held 1.298s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Created reservations ['2fa1941a-c265-4c89-b147-57e26d54d7cd', '9a74b7f3-b0ec-4922-86d2-acfcef9ec414', 'c4b8dcde-d8cb-4b55-ac45-ede545eab53d', '2090006e-c121-4a1f-8520-7d1e03c36902'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:42 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:42 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:43 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.716s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:43 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:43 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Deleted volume successfully. Jul 20 16:47:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-77220e45-51ca-4cab-b9de-4c3bf7cf1aac tempest-VolumesActionsTest-2010831024 None] Lock "cinder-23b80662-7018-4e62-9c86-048349d11594-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (e11705a2-da37-4eb1-b469-514a38896cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056c73e9-a293-4aa3-9ddb-88d7155c39a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056c73e9-a293-4aa3-9ddb-88d7155c39a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013368144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babb9c62-c548-444e-967e-8e9a3b987579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:44Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50ce5b8-f461-4f9f-9ec2-c68cb5dc8472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50ce5b8-f461-4f9f-9ec2-c68cb5dc8472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bbb5c9-0188-4fc2-8479-c49416a1974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bbb5c9-0188-4fc2-8479-c49416a1974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babb9c62-c548-444e-967e-8e9a3b987579', 'volume_name': 'volume-babb9c62-c548-444e-967e-8e9a3b987579', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b611e9-bef2-46d2-a543-56f37703cef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b611e9-bef2-46d2-a543-56f37703cef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df3ce4e-2290-4581-a657-e13c16eb131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:44 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Volume babb9c62-c548-444e-967e-8e9a3b987579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babb9c62-c548-444e-967e-8e9a3b987579', 'volume_size': 1} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1013368144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babb9c62-c548-444e-967e-8e9a3b987579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:44Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Creating volume babb9c62-c548-444e-967e-8e9a3b987579 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:44 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:44 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 1073741824 Jul 20 16:47:44 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:45 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 1073741824" returned: 0 in 0.856s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:45 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 Jul 20 16:47:45 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:45 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579" returned: 0 in 0.443s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df3ce4e-2290-4581-a657-e13c16eb131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babb9c62-c548-444e-967e-8e9a3b987579', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f05c7ef-c829-4031-a816-aa1c85764d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:46 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Volume volume-babb9c62-c548-444e-967e-8e9a3b987579 (babb9c62-c548-444e-967e-8e9a3b987579): created successfully Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f05c7ef-c829-4031-a816-aa1c85764d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (e11705a2-da37-4eb1-b469-514a38896cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a17fe232-cd31-45fd-9f17-180fbd9f9a61 tempest-VolumesActionsTest-1500041683 None] Created volume successfully. Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-babb9c62-c548-444e-967e-8e9a3b987579-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Lock "cinder-babb9c62-c548-444e-967e-8e9a3b987579-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Acquiring lock "cinder-quobyte-babb9c62-c548-444e-967e-8e9a3b987579" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-babb9c62-c548-444e-967e-8e9a3b987579" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a058e87e-1a03-4ed8-9f4d-945baacdca35]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:46 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 Jul 20 16:47:46 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:47 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579" returned: 0 in 0.641s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:47 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579 Jul 20 16:47:47 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:47 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-babb9c62-c548-444e-967e-8e9a3b987579" returned: 0 in 0.413s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Lock "cinder-quobyte-babb9c62-c548-444e-967e-8e9a3b987579" released by "delete_volume" :: held 1.132s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Created reservations ['fb2879ca-48b0-48f4-b305-fecf82ff36a7', '4dabe813-a2fe-4c28-a008-b9ecb0e6dcfd', 'a0cbf0e6-0684-4a10-a554-727c015afad0', '3365d284-eadf-4cad-a088-c4630ba22cf8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:48 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:48 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:48 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.314s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Deleted volume successfully. Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f7a8983b-6d19-4c15-bd56-2c373b2f89b3 tempest-VolumesActionsTest-2010831024 None] Lock "cinder-babb9c62-c548-444e-967e-8e9a3b987579-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Acquiring lock "cinder-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "cinder-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Acquiring lock "cinder-quobyte-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "cinder-quobyte-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aef724-44e3-4cb5-8bac-483c7d40eba7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:49 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e Jul 20 16:47:49 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:49 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e" returned: 0 in 0.547s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:49 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e Jul 20 16:47:49 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (847b6311-8bc5-463a-8c02-a0b548f982ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e1f41e-e74b-41ae-817f-10251e0961fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e1f41e-e74b-41ae-817f-10251e0961fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202304007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca2bd73-06b5-40a8-8d20-6086a7a6925a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:50Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8462d3-729d-45fe-9364-6b3109ca64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8462d3-729d-45fe-9364-6b3109ca64fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192972ea-b83f-4ad0-9c2d-cd3009b1c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192972ea-b83f-4ad0-9c2d-cd3009b1c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca2bd73-06b5-40a8-8d20-6086a7a6925a', 'volume_name': 'volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3b1e2f-efd9-4054-8e48-e875879d0a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3b1e2f-efd9-4054-8e48-e875879d0a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6351160d-c229-47e4-81bb-8b3705991e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:50 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Volume 0ca2bd73-06b5-40a8-8d20-6086a7a6925a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a', 'volume_size': 1} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202304007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca2bd73-06b5-40a8-8d20-6086a7a6925a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f3d22f8f7e4c369add2e216f073026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:47:50Z,use_quota=True,user_id='8573bc48a45c48a8a9853cf8ec3cf296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Creating volume 0ca2bd73-06b5-40a8-8d20-6086a7a6925a {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:47:50 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:50 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a 1073741824 Jul 20 16:47:50 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:50 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e" returned: 0 in 0.610s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "cinder-quobyte-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e" released by "delete_volume" :: held 1.215s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Created reservations ['cf965e52-29a7-4aa5-9c3f-73f286a53132', 'da231cdb-191a-4c3e-8263-ef9de5dc161d', 'fcb505fe-8302-4a63-96e4-298adbbc62da', 'b56b61e7-ec4d-44c4-9beb-796629f702b2'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:50 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:50 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:50 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.376s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:50 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Deleted volume successfully. Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d62f9789-da2b-4b97-b495-051cb176fcc6 tempest-AttachVolumeShelveTestJSON-1059492282 None] Lock "cinder-ac1b7bfa-e12f-4cd8-b7d4-47aa3b92fc6e-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:50 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a 1073741824" returned: 0 in 0.803s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:50 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a Jul 20 16:47:50 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:51 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a" returned: 0 in 0.338s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6351160d-c229-47e4-81bb-8b3705991e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b205d56-b87b-4cea-b69d-c84ad9e4d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:47:51 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Volume volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a (0ca2bd73-06b5-40a8-8d20-6086a7a6925a): created successfully Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b205d56-b87b-4cea-b69d-c84ad9e4d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:47:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Flow 'volume_create_manager' (847b6311-8bc5-463a-8c02-a0b548f982ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:47:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-48b99891-b137-440c-8f6d-f604bef45d27 tempest-VolumesActionsTest-1500041683 None] Created volume successfully. Jul 20 16:47:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Acquiring lock "cinder-0ca2bd73-06b5-40a8-8d20-6086a7a6925a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Lock "cinder-0ca2bd73-06b5-40a8-8d20-6086a7a6925a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Acquiring lock "cinder-quobyte-0ca2bd73-06b5-40a8-8d20-6086a7a6925a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:47:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Lock "cinder-quobyte-0ca2bd73-06b5-40a8-8d20-6086a7a6925a" acquired by "delete_volume" :: waited 0.057s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:47:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f8d66-ec13-4868-a2a8-be2d65180fb9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:47:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:54 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a Jul 20 16:47:54 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:54 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a" returned: 0 in 0.494s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:54 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a Jul 20 16:47:54 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:54 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ca2bd73-06b5-40a8-8d20-6086a7a6925a" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Lock "cinder-quobyte-0ca2bd73-06b5-40a8-8d20-6086a7a6925a" released by "delete_volume" :: held 0.872s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Created reservations ['f437f224-13d9-4c6e-b0bd-a45a9e1e3152', '7bd9d7e6-7fcc-4bcb-8fde-cd068f6088e5', '61b2e12c-e528-4f03-a381-5467c4b5dd61', '50ede218-5885-4e5b-badd-fdf40df3de43'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:47:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:47:54 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:47:54 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:47:55 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 20 16:47:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.294s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:47:55 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:47:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Deleted volume successfully. Jul 20 16:47:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8a25cb6c-fb68-4ada-97c9-ef7fb308161b tempest-VolumesActionsTest-1500041683 None] Lock "cinder-0ca2bd73-06b5-40a8-8d20-6086a7a6925a-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-eea82ad7-3e91-490c-b8d4-6b43bda6449b tempest-BackendsCapabilitiesAdminTestsJSON-271363546 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87535) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 20 16:48:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5361c979-e8f8-492d-b9e0-f5b052c58e94 tempest-BackendsCapabilitiesAdminTestsJSON-271363546 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87535) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 20 16:48:04 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=77,cinder:UPDATE=93,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:48:05 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=60,cinder:UPDATE=84,cinder:DELETE=11,cinder:INSERT=18 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:48:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-f5d75289-1835-418e-b411-69ce52a24dfd req-d111eddd-2022-4f37-9422-98621cb34daa tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-f5d75289-1835-418e-b411-69ce52a24dfd req-d111eddd-2022-4f37-9422-98621cb34daa tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-f5d75289-1835-418e-b411-69ce52a24dfd req-d111eddd-2022-4f37-9422-98621cb34daa tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-f5d75289-1835-418e-b411-69ce52a24dfd req-d111eddd-2022-4f37-9422-98621cb34daa tempest-TestServerVolumeAttachmentScenario-1034849530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c9007e4-fd6b-4e8c-ace6-4a29f7a64a35', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:48:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-f5d75289-1835-418e-b411-69ce52a24dfd req-d111eddd-2022-4f37-9422-98621cb34daa tempest-TestServerVolumeAttachmentScenario-1034849530 None] attachment_update completed successfully. Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Flow 'volume_create_manager' (86ca3885-e10b-433a-9245-94dd96e36ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feae4d95-fc8d-45fd-b9d1-787e3e088e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feae4d95-fc8d-45fd-b9d1-787e3e088e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756718959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7063f-1f3d-4340-8113-c727c2e436b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53939c88424e4369b2d65941cc764a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:10Z,use_quota=True,user_id='d66cf793e62946e28f8cd57556bcc023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b00c1b1-1f1b-44a3-ac59-0b379f625e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b00c1b1-1f1b-44a3-ac59-0b379f625e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ee0953-cb2e-43a7-8936-37e87ced335d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ee0953-cb2e-43a7-8936-37e87ced335d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb7063f-1f3d-4340-8113-c727c2e436b4', 'volume_name': 'volume-dfb7063f-1f3d-4340-8113-c727c2e436b4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c492535f-d834-4b23-8efc-81be9918d281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c492535f-d834-4b23-8efc-81be9918d281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6b226-1e16-4dca-bab7-a1ae04b544fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:10 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Volume dfb7063f-1f3d-4340-8113-c727c2e436b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb7063f-1f3d-4340-8113-c727c2e436b4', 'volume_size': 1} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756718959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7063f-1f3d-4340-8113-c727c2e436b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53939c88424e4369b2d65941cc764a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:10Z,use_quota=True,user_id='d66cf793e62946e28f8cd57556bcc023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Creating volume dfb7063f-1f3d-4340-8113-c727c2e436b4 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:10 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:10 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 1073741824 Jul 20 16:48:10 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:10 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 1073741824" returned: 0 in 0.512s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:10 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 Jul 20 16:48:10 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:10 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4" returned: 0 in 0.279s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6b226-1e16-4dca-bab7-a1ae04b544fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb7063f-1f3d-4340-8113-c727c2e436b4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874682de-5917-4faa-94ba-4dddace08d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:10 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Volume volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 (dfb7063f-1f3d-4340-8113-c727c2e436b4): created successfully Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874682de-5917-4faa-94ba-4dddace08d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Flow 'volume_create_manager' (86ca3885-e10b-433a-9245-94dd96e36ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7f1e1b39-a14b-439f-bfd6-079bdb907c8d tempest-VolumesListAdminTestJSON-319923098 None] Created volume successfully. Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Flow 'volume_create_manager' (c1230e89-e9c6-4a83-8ef6-c55db043f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe75cbcd-3a41-4b46-92f2-10be5106b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe75cbcd-3a41-4b46-92f2-10be5106b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-918692790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53939c88424e4369b2d65941cc764a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:13Z,use_quota=True,user_id='d66cf793e62946e28f8cd57556bcc023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ce6746-8a90-464e-8898-3a63de56d206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ce6746-8a90-464e-8898-3a63de56d206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61b1c50-be12-4f91-a83f-69fa1f77939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61b1c50-be12-4f91-a83f-69fa1f77939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1', 'volume_name': 'volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bb028c-cc57-4e81-9080-cc88b44199b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bb028c-cc57-4e81-9080-cc88b44199b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6fd8f-13ca-4728-b613-a0b1fa22ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Volume c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1', 'volume_size': 1} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-918692790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53939c88424e4369b2d65941cc764a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:13Z,use_quota=True,user_id='d66cf793e62946e28f8cd57556bcc023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Creating volume c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:12 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:12 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 1073741824 Jul 20 16:48:12 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:13 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 1073741824" returned: 0 in 0.585s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:13 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 Jul 20 16:48:13 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:13 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1" returned: 0 in 0.332s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6fd8f-13ca-4728-b613-a0b1fa22ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c5c388-aef5-4f72-87a2-2305add1e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Volume volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 (c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1): created successfully Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c5c388-aef5-4f72-87a2-2305add1e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Flow 'volume_create_manager' (c1230e89-e9c6-4a83-8ef6-c55db043f732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9112e2fc-0def-402c-bf96-d4db137dea52 tempest-VolumesListAdminTestJSON-319923098 None] Created volume successfully. Jul 20 16:48:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-b1b07d8d-ac22-40c7-a839-8259a3eb82e0 req-f71fbc0c-3768-4140-8285-2c16835f1a4f tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-b1b07d8d-ac22-40c7-a839-8259a3eb82e0 req-f71fbc0c-3768-4140-8285-2c16835f1a4f tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-b1b07d8d-ac22-40c7-a839-8259a3eb82e0 req-f71fbc0c-3768-4140-8285-2c16835f1a4f tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-b1b07d8d-ac22-40c7-a839-8259a3eb82e0 req-f71fbc0c-3768-4140-8285-2c16835f1a4f tempest-TestServerVolumeAttachmentScenario-1034849530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-58dc83db-0b94-461b-9e3d-ac77b840b44c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c622ccc8-73b8-482d-900b-c9faf816175e', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:48:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-b1b07d8d-ac22-40c7-a839-8259a3eb82e0 req-f71fbc0c-3768-4140-8285-2c16835f1a4f tempest-TestServerVolumeAttachmentScenario-1034849530 None] attachment_update completed successfully. Jul 20 16:48:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-38960b8e-d38f-4e21-890c-32feace7f4d4 tempest-GroupsV314Test-790481659 None] Group tempest-GroupsV314Test-Group-1233473332: creating Jul 20 16:48:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-38960b8e-d38f-4e21-890c-32feace7f4d4 tempest-GroupsV314Test-790481659 None] Group tempest-GroupsV314Test-Group-1233473332: created successfully Jul 20 16:48:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-38960b8e-d38f-4e21-890c-32feace7f4d4 tempest-GroupsV314Test-790481659 None] Create group completed successfully. Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Flow 'volume_create_manager' (14bcf34b-cce4-43b0-8cc5-a492029392d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc750a7-4fea-4c71-835b-8d2347948f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc750a7-4fea-4c71-835b-8d2347948f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-767777759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28c756d-5bb2-46a9-a2e3-d4ab206cd0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53939c88424e4369b2d65941cc764a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:15Z,use_quota=True,user_id='d66cf793e62946e28f8cd57556bcc023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec0f5b6-15c0-45cb-b008-aa933aca0255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec0f5b6-15c0-45cb-b008-aa933aca0255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d0d6f4-ef2e-4b96-a1e8-a3c6589f54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d0d6f4-ef2e-4b96-a1e8-a3c6589f54a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28c756d-5bb2-46a9-a2e3-d4ab206cd0da', 'volume_name': 'volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43622b7f-8e79-451b-9c79-6e589159a9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43622b7f-8e79-451b-9c79-6e589159a9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee778923-9cbf-4558-a9e5-71cfb141d325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Volume e28c756d-5bb2-46a9-a2e3-d4ab206cd0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da', 'volume_size': 1} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-767777759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28c756d-5bb2-46a9-a2e3-d4ab206cd0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53939c88424e4369b2d65941cc764a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:15Z,use_quota=True,user_id='d66cf793e62946e28f8cd57556bcc023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Creating volume e28c756d-5bb2-46a9-a2e3-d4ab206cd0da {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:15 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:15 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da 1073741824 Jul 20 16:48:15 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-c67cb86d-3f6d-4a5f-96ce-164f90d4089e req-52323a16-9f9c-44c3-aa25-018ddd0fbcd2 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Terminate volume connection completed successfully. Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-c67cb86d-3f6d-4a5f-96ce-164f90d4089e req-52323a16-9f9c-44c3-aa25-018ddd0fbcd2 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Deleting attachment c622ccc8-73b8-482d-900b-c9faf816175e. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:48:15 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da 1073741824" returned: 0 in 0.501s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:16 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da Jul 20 16:48:16 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Flow 'volume_create_manager' (6d6a5ed3-a737-448e-abce-2cc7e18ddd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8cf6e3-defa-49b3-9ac9-c211fff786a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8cf6e3-defa-49b3-9ac9-c211fff786a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-72862404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fcc2793-6085-4dda-a8fb-77e8718011d0,host='devstack@QuobyteHD#QuobyteHD',id=d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e30b364099f4343af6a1ec851aa8040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:16Z,use_quota=True,user_id='755cf9666ad74a9fb68777c57e966374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acec5e82-f621-4ed9-8040-8b80787c4afa),volume_type_id=acec5e82-f621-4ed9-8040-8b80787c4afa)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b553e46b-e20f-4da8-93e8-5fd4262b162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b553e46b-e20f-4da8-93e8-5fd4262b162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61562a7d-b49c-4d94-986f-0d51f1881813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61562a7d-b49c-4d94-986f-0d51f1881813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6', 'volume_name': 'volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4068813-f995-4d1a-a46d-2462061f673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4068813-f995-4d1a-a46d-2462061f673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4837a8a-a960-45ad-8a02-01ab48c407bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Volume d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6', 'volume_size': 1} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:16 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da" returned: 0 in 0.272s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fcc2793-6085-4dda-a8fb-77e8718011d0,created_at=2026-07-20T14:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-72862404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fcc2793-6085-4dda-a8fb-77e8718011d0,host='devstack@QuobyteHD#QuobyteHD',id=d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e30b364099f4343af6a1ec851aa8040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:16Z,use_quota=True,user_id='755cf9666ad74a9fb68777c57e966374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acec5e82-f621-4ed9-8040-8b80787c4afa),volume_type_id=acec5e82-f621-4ed9-8040-8b80787c4afa)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Creating volume d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:16 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee778923-9cbf-4558-a9e5-71cfb141d325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccc97cd-f551-4816-b674-e57376292345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:16 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 1073741824 Jul 20 16:48:16 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Volume volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da (e28c756d-5bb2-46a9-a2e3-d4ab206cd0da): created successfully Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccc97cd-f551-4816-b674-e57376292345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Flow 'volume_create_manager' (14bcf34b-cce4-43b0-8cc5-a492029392d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-00d97072-e625-4266-b24e-ddd7b975d86d tempest-VolumesListAdminTestJSON-319923098 None] Created volume successfully. Jul 20 16:48:16 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 1073741824" returned: 0 in 0.459s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:16 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:16 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:17 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4837a8a-a960-45ad-8a02-01ab48c407bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdff92a4-a947-40b0-9f7c-2c3482c75c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:17 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Volume volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 (d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6): created successfully Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdff92a4-a947-40b0-9f7c-2c3482c75c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Flow 'volume_create_manager' (6d6a5ed3-a737-448e-abce-2cc7e18ddd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-40491ebc-1039-4029-a816-689d432cd714 tempest-GroupsV314Test-790481659 None] Created volume successfully. Jul 20 16:48:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-8a625db7-77ac-498d-bddf-edf1a15c7488 req-8531c2e9-49e6-43a4-93be-6a706c2e673e tempest-TestServerVolumeAttachmentScenario-1034849530 None] Terminate volume connection completed successfully. Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-8a625db7-77ac-498d-bddf-edf1a15c7488 req-8531c2e9-49e6-43a4-93be-6a706c2e673e tempest-TestServerVolumeAttachmentScenario-1034849530 None] Deleting attachment 1c9007e4-fd6b-4e8c-ace6-4a29f7a64a35. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:17 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Cloning volume d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 to volume 626b3b2f-18c2-4175-a530-14ddd6d6f3cd Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Creating offline snapshot 9a7ff468-a90b-41a8-8182-dc755fce500f of volume d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Flow 'volume_create_manager' (db1a2163-5039-46f6-b46c-2b18e9725087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193e504f-d89c-4e54-9bc5-5740bf279b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[376ed547-9a85-4cd4-bcf1-ba5d26b28474]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193e504f-d89c-4e54-9bc5-5740bf279b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1700632505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad711df716f499c8c0436d5bb857304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:18Z,use_quota=True,user_id='b138098d576745578a45bc4aa67d0262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff309efb-1cca-4777-9eb9-a31dbf5de47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff309efb-1cca-4777-9eb9-a31dbf5de47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbbbc36-c559-40f3-9379-8052193fa146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbbbc36-c559-40f3-9379-8052193fa146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c', 'volume_name': 'volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a02caaf-d183-45f1-ab23-827e15ca9ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a02caaf-d183-45f1-ab23-827e15ca9ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae97da6-2a05-472d-92e6-418a9e2ae87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:18 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Volume 81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c', 'volume_size': 1} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:18 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:18 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:18 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.544s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:18 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f 1G Jul 20 16:48:18 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Flow 'volume_create_manager' (c2db0990-22ee-470c-acfa-c46500486d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d94fae9-4d95-46ec-9630-ad2bdd0bb111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d94fae9-4d95-46ec-9630-ad2bdd0bb111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7164c3ae-ff86-4883-9e3a-cdb7fe54a97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5862584d44d2aba193e3b4ec82ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:19Z,use_quota=True,user_id='07b76bfdee464afab0243851ed67505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629a8404-01b7-4cd9-be10-708793be790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629a8404-01b7-4cd9-be10-708793be790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73612238-a6a7-43f7-a9a7-d4944d683bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73612238-a6a7-43f7-a9a7-d4944d683bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7164c3ae-ff86-4883-9e3a-cdb7fe54a97d', 'volume_name': 'volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c878bbac-f6d6-4011-afcd-b9ca24937903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c878bbac-f6d6-4011-afcd-b9ca24937903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3aabcd-5d63-4ecd-80af-e96d6215a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:19 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Volume 7164c3ae-ff86-4883-9e3a-cdb7fe54a97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d', 'volume_size': 1} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:19 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f 1G" returned: 0 in 0.643s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:19 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f Jul 20 16:48:19 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:19 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f" returned: 0 in 0.366s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:19 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:19 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f Jul 20 16:48:19 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:19 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:19 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info Jul 20 16:48:20 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:20 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:20 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:20 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info Jul 20 16:48:20 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:20 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.info" returned: 0 in 0.273s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Acquiring lock "cinder-quobyte-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] snapshot: 9a7ff468-a90b-41a8-8182-dc755fce500f, volume: 626b3b2f-18c2-4175-a530-14ddd6d6f3cd, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c2396-e3f3-4b42-a701-6cc323d92f9c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:20 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f Jul 20 16:48:20 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:21 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f" returned: 0 in 0.356s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[232aa2dd-7dc9-4643-bb86-fb60616fadd2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:21 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:21 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:21 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:48:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:21 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd Jul 20 16:48:21 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "cinder-58dc83db-0b94-461b-9e3d-ac77b840b44c-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-58dc83db-0b94-461b-9e3d-ac77b840b44c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "cinder-quobyte-58dc83db-0b94-461b-9e3d-ac77b840b44c" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-quobyte-58dc83db-0b94-461b-9e3d-ac77b840b44c" acquired by "delete_volume" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93220c-9254-4edc-b650-27115495f2bb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:22 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c Jul 20 16:48:22 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:23 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c" returned: 0 in 0.806s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:23 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c Jul 20 16:48:23 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:24 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-58dc83db-0b94-461b-9e3d-ac77b840b44c" returned: 0 in 0.698s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-quobyte-58dc83db-0b94-461b-9e3d-ac77b840b44c" released by "delete_volume" :: held 1.585s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Created reservations ['9a1761cd-d9a7-4af0-90c1-0f94f73ce581', '4e8a87d5-aa88-4963-8d10-90a21150195a', '6bc7c3d8-6dfb-4e3a-be3c-221fca281009', 'a3b8ef05-d29a-4fde-a4e2-958470bfc483'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:24 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:24 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:24 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "cinder-4364f5a8-3237-46b2-9b4b-2df4285b31d9-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.595s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:24 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Deleted volume successfully. Jul 20 16:48:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-4364f5a8-3237-46b2-9b4b-2df4285b31d9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-811ed4e6-cba2-4471-a623-beaa7bac9b91 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-58dc83db-0b94-461b-9e3d-ac77b840b44c-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "cinder-quobyte-4364f5a8-3237-46b2-9b4b-2df4285b31d9" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-quobyte-4364f5a8-3237-46b2-9b4b-2df4285b31d9" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:25 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[514d97db-948b-475a-9de5-c70409949dfb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:25 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 Jul 20 16:48:25 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:26 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9" returned: 0 in 1.014s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:26 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9 Jul 20 16:48:26 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:26 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" returned: 0 in 4.957s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e3fe40-47d4-4d01-b5d6-b7800228f72d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:26 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:26 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:26 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4364f5a8-3237-46b2-9b4b-2df4285b31d9" returned: 0 in 0.323s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-quobyte-4364f5a8-3237-46b2-9b4b-2df4285b31d9" released by "delete_volume" :: held 1.411s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Created reservations ['c5e85032-ca6c-40c3-9509-5599d8378105', '0cee8bec-e525-46a3-bb4e-395328da7790', '929872ee-5c70-4d0b-9101-d73dcd2ac75e', 'b621b557-72a4-4524-9672-a0e9aeba5ec1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:26 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:26 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:26 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:26 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Deleted volume successfully. Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46ac888b-63d8-4fe3-bcd9-35ed57cc2ab3 tempest-TestServerVolumeAttachmentScenario-1034849530 None] Lock "cinder-4364f5a8-3237-46b2-9b4b-2df4285b31d9-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:26 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.567s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:48:26 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Converted 1024.00 MB image at 206.53 MB/s Jul 20 16:48:26 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:48:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:27 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd Jul 20 16:48:27 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:27 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" released by "_copy_volume_from_snapshot" :: held 6.588s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Acquiring lock "cinder-quobyte-9a7ff468-a90b-41a8-8182-dc755fce500f" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-9a7ff468-a90b-41a8-8182-dc755fce500f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Deleting offline snapshot 9a7ff468-a90b-41a8-8182-dc755fce500f of volume d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] snapshot_file for this snap is: volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[061fd8df-6971-4ecf-87e8-155ff880f083]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:27 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f Jul 20 16:48:27 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:27 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f" returned: 0 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d4b1a-c053-4a7d-a2fd-7ed643d88a2f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:27 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:27 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:28 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.385s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:28 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f Jul 20 16:48:28 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:28 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f" returned: 0 in 0.349s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:28 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f Jul 20 16:48:28 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:28 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6.9a7ff468-a90b-41a8-8182-dc755fce500f" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-9a7ff468-a90b-41a8-8182-dc755fce500f" released by "_delete_snapshot" :: held 1.473s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.820s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.574s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1700632505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad711df716f499c8c0436d5bb857304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:18Z,use_quota=True,user_id='b138098d576745578a45bc4aa67d0262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Creating volume 81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:28 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:28 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c 1073741824 Jul 20 16:48:28 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-34d44edd-c97f-4567-a216-8534c34fe0a3 tempest-GroupsV314Test-790481659 None] Create group from source-group-1fcc2793-6085-4dda-a8fb-77e8718011d0 completed successfully. Jul 20 16:48:29 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c 1073741824" returned: 0 in 0.474s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:29 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c Jul 20 16:48:29 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:29 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.510s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7164c3ae-ff86-4883-9e3a-cdb7fe54a97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b5862584d44d2aba193e3b4ec82ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:19Z,use_quota=True,user_id='07b76bfdee464afab0243851ed67505a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Creating volume 7164c3ae-ff86-4883-9e3a-cdb7fe54a97d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:29 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae97da6-2a05-472d-92e6-418a9e2ae87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:29 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d 1073741824 Jul 20 16:48:29 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc69509-159d-4370-9a15-a614d07f23ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Volume volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c (81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c): created successfully Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc69509-159d-4370-9a15-a614d07f23ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Flow 'volume_create_manager' (db1a2163-5039-46f6-b46c-2b18e9725087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-177d7c07-5b2d-4e75-8a94-e07dd5f07078 tempest-AttachVolumeNegativeTest-1042691458 None] Created volume successfully. Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Acquiring lock "cinder-quobyte-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb60512-a2cc-4484-90e5-abba64fa317e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:30 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d 1073741824" returned: 0 in 0.621s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:30 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d Jul 20 16:48:30 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:30 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd Jul 20 16:48:30 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:30 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3aabcd-5d63-4ecd-80af-e96d6215a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:30 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be9e004-ed35-45bb-b4e2-1b674df68bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" returned: 0 in 0.471s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Volume volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d (7164c3ae-ff86-4883-9e3a-cdb7fe54a97d): created successfully Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be9e004-ed35-45bb-b4e2-1b674df68bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Flow 'volume_create_manager' (c2db0990-22ee-470c-acfa-c46500486d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:30 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd Jul 20 16:48:30 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-131db8c9-9e21-4018-8c27-9acf9647e919 tempest-VolumesListAdminTestJSON-1735946541 None] Created volume successfully. Jul 20 16:48:30 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" returned: 0 in 0.321s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-626b3b2f-18c2-4175-a530-14ddd6d6f3cd" released by "delete_volume" :: held 0.849s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Created reservations ['80623bdb-4594-4037-8a1b-0ae348fc9ff2'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:31 devstack cinder-volume[87535]: WARNING cinder.quota [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2100730803 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2100730803, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:48:31 devstack cinder-volume[87535]: WARNING cinder.quota [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2100730803 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2100730803, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Created reservations ['826310db-618b-43ec-84ae-b4864e5cad54', '058fd983-c2e9-49b3-be12-0f700b35076d', '7f9b2e31-69b2-480e-858b-f18717912dc6', 'dd68c8dd-ac7a-4ad8-9921-66fb2030f2a2'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-20df7e45-6bb8-47ed-ab76-e9f9a5c4024a req-f3e76109-fd5e-443c-a992-64c4ce5dc163 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-20df7e45-6bb8-47ed-ab76-e9f9a5c4024a req-f3e76109-fd5e-443c-a992-64c4ce5dc163 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-20df7e45-6bb8-47ed-ab76-e9f9a5c4024a req-f3e76109-fd5e-443c-a992-64c4ce5dc163 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-20df7e45-6bb8-47ed-ab76-e9f9a5c4024a req-f3e76109-fd5e-443c-a992-64c4ce5dc163 tempest-AttachVolumeNegativeTest-1042691458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dbcfcb8-d482-4332-9b7b-57bd30d216b7', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:31 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:31 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-20df7e45-6bb8-47ed-ab76-e9f9a5c4024a req-f3e76109-fd5e-443c-a992-64c4ce5dc163 tempest-AttachVolumeNegativeTest-1042691458 None] attachment_update completed successfully. Jul 20 16:48:31 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9c597d30-1dc4-4e48-b974-935b204b4ce8 tempest-GroupsV314Test-790481659 None] Delete group completed successfully. Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Acquiring lock "cinder-quobyte-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ffbd0-bc05-41e8-a734-261bcbe79510]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:31 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:31 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Acquiring lock "cinder-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Lock "cinder-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Acquiring lock "cinder-quobyte-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Lock "cinder-quobyte-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d" acquired by "delete_volume" :: waited 0.042s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb535aa0-e2a8-40db-88ca-ad3effcd3519]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "cinder-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "cinder-quobyte-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-quobyte-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:32 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.728s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cdfd1b-5a6c-451c-91a8-10b276bd263b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:32 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6 Jul 20 16:48:32 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:32 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d Jul 20 16:48:32 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:32 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da Jul 20 16:48:32 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:32 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" returned: 0 in 0.318s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:32 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d" returned: 0 in 0.531s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Lock "cinder-quobyte-d54a6f4b-ecb2-4eda-9e37-638d2ff6e7c6" released by "delete_volume" :: held 1.151s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:32 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d Jul 20 16:48:32 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Created reservations ['353a7a48-acb1-42e9-aaa2-17298fca2908'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:33 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da" returned: 0 in 0.460s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:33 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da Jul 20 16:48:33 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Created reservations ['6cfef450-e13b-4dce-8b73-9328d6301935', '52ade1d1-512e-4df5-ad18-216d9d48ae0a', '7b864e6c-5243-480c-a5f5-87a8a9f2db28', 'ad710dd6-4fce-4483-b729-c5a7074afec1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:33 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Lock "cinder-quobyte-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d" released by "delete_volume" :: held 0.996s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:33 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:33 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Created reservations ['af83bea3-afed-4091-b1d2-d298c691a53c', '02ff47a5-afa8-42c5-876c-288f3c55059e', 'd57e27ac-05fb-49e4-b2c3-ea37efa11ee4', 'aa484a06-ab36-42b3-9bb2-294228e62c07'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:33 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da" returned: 0 in 0.486s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-quobyte-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da" released by "delete_volume" :: held 1.017s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:33 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:33 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Created reservations ['f97fecf2-be9d-4f73-8c88-9def0b9fc696', '3236f8ff-1bb6-48eb-b605-863a1e8f3db7', '4a5c5804-9947-492b-8c25-acb9c166649b', '507c26e1-f268-44e6-ab6f-6132387649c9'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:33 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7891a1e5-72b5-4010-b95b-6a52ae46dc00 tempest-GroupsV314Test-790481659 None] Delete group completed successfully. Jul 20 16:48:33 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:33 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:33 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:33 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Deleted volume successfully. Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-63944213-d9b5-4639-84e2-ae3b702f561a tempest-VolumesListAdminTestJSON-1735946541 None] Lock "cinder-7164c3ae-ff86-4883-9e3a-cdb7fe54a97d-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:34 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Deleted volume successfully. Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce568db8-9bd9-4768-b8a0-601ecb0df956 tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-e28c756d-5bb2-46a9-a2e3-d4ab206cd0da-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-d6aea581-3c48-4b15-9a23-3f46903443d1 req-d4d9660d-f305-4308-83de-4ca2cfe9a676 tempest-AttachVolumeNegativeTest-1042691458 None] Terminate volume connection completed successfully. Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-d6aea581-3c48-4b15-9a23-3f46903443d1 req-d4d9660d-f305-4308-83de-4ca2cfe9a676 tempest-AttachVolumeNegativeTest-1042691458 None] Deleting attachment 3dbcfcb8-d482-4332-9b7b-57bd30d216b7. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "cinder-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "cinder-quobyte-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-quobyte-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1" acquired by "delete_volume" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f244a-36d0-46d2-ad41-5047eaffe9d2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:35 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 Jul 20 16:48:35 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:35 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1" returned: 0 in 0.495s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:35 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1 Jul 20 16:48:35 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:35 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-quobyte-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1" released by "delete_volume" :: held 0.889s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:35 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Created reservations ['7c0358c4-39de-4afa-ac19-fcd6af018deb', '4e813640-17a7-4378-96f8-6622d4a60592', '32da3941-46da-4ad3-94c4-07011bb78155', '133c7add-0417-4de0-a23d-1e8446ce2d86'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:36 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:36 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:36 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.292s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Deleted volume successfully. Jul 20 16:48:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb0cb9e2-6bf2-4d8e-8383-ae5d37e0be8f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-c4ba0fd9-3e30-4ccb-9ad9-626e069e34c1-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "cinder-dfb7063f-1f3d-4340-8113-c727c2e436b4-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-dfb7063f-1f3d-4340-8113-c727c2e436b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "cinder-quobyte-dfb7063f-1f3d-4340-8113-c727c2e436b4" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-quobyte-dfb7063f-1f3d-4340-8113-c727c2e436b4" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136c5e5-6931-479e-8a04-8b7dd5d6e7b2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:37 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 Jul 20 16:48:37 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:37 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4" returned: 0 in 0.456s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:37 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4 Jul 20 16:48:37 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:38 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dfb7063f-1f3d-4340-8113-c727c2e436b4" returned: 0 in 0.304s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-quobyte-dfb7063f-1f3d-4340-8113-c727c2e436b4" released by "delete_volume" :: held 0.806s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Created reservations ['1e782141-1d6a-421b-ace7-8c40280bae28', '30d3f655-2ff8-44e2-8673-3deb415b7437', '046f00b5-8e73-42b9-89e7-edc98b3fcc9f', '4c639b5f-6c39-4ae0-bbfd-ea4cc75d279b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:38 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:38 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:38 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.381s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:38 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Deleted volume successfully. Jul 20 16:48:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-09f0307a-57aa-4eb4-9d5c-4d64b5fa703f tempest-VolumesListAdminTestJSON-319923098 None] Lock "cinder-dfb7063f-1f3d-4340-8113-c727c2e436b4-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:39 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:39 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:39 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.354s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:48:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "cinder-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "cinder-quobyte-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-quobyte-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[13609d52-9de0-45c8-81d5-4c3ccbb6d479]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:41 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c Jul 20 16:48:41 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:41 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c" returned: 0 in 0.494s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:41 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c Jul 20 16:48:41 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:41 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c" returned: 0 in 0.307s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-quobyte-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c" released by "delete_volume" :: held 0.869s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Created reservations ['c9e18e1d-4941-4b11-91db-b54900d5d008', 'f959b4dd-40c8-4bb7-9759-66df213adfe7', 'a16a4752-081d-4c38-a006-a3070b32def3', '61cbdf4a-5012-4bc9-8a00-8b3b2cd5b116'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (f69b3338-69c2-457d-b904-1a7074255a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb40041-2af6-489e-a2fd-56faf5fa61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb40041-2af6-489e-a2fd-56faf5fa61da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1494786340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c01eed5-7366-45e7-b845-e6002b0781df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:42Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24601d6b-611c-41d8-b3db-fed59660c626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24601d6b-611c-41d8-b3db-fed59660c626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6292a8-39a9-4245-bbad-4cf2f48ea661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6292a8-39a9-4245-bbad-4cf2f48ea661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c01eed5-7366-45e7-b845-e6002b0781df', 'volume_name': 'volume-4c01eed5-7366-45e7-b845-e6002b0781df', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d013d585-cba5-44ae-8fe2-353897b85892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d013d585-cba5-44ae-8fe2-353897b85892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361ebbc6-99f4-417c-900f-7fcd856db98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:42 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Volume 4c01eed5-7366-45e7-b845-e6002b0781df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c01eed5-7366-45e7-b845-e6002b0781df', 'volume_size': 1} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1494786340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c01eed5-7366-45e7-b845-e6002b0781df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:42Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Creating volume 4c01eed5-7366-45e7-b845-e6002b0781df {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:42 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:42 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df 1073741824 Jul 20 16:48:42 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:42 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:42 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:42 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.361s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Deleted volume successfully. Jul 20 16:48:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce1aae48-24b3-4a83-bc84-e5a494d9e94e tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-81a0fbfd-76d3-4d50-83f4-9d3b3cd65b3c-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:43 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df 1073741824" returned: 0 in 0.792s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "cinder-e3fcb151-68fc-4915-a646-b4904b521a2b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-e3fcb151-68fc-4915-a646-b4904b521a2b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:43 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df Jul 20 16:48:43 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "cinder-quobyte-e3fcb151-68fc-4915-a646-b4904b521a2b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-quobyte-e3fcb151-68fc-4915-a646-b4904b521a2b" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b7fb6f-9d1d-4e8e-a6f8-33909e16566b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Flow 'volume_create_manager' (9e4c0571-601c-4a7a-935a-046ce8a4228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1f70b6-15a6-4b58-a8ed-fabfdec0d8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b Jul 20 16:48:43 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1f70b6-15a6-4b58-a8ed-fabfdec0d8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1532444410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112d878b-a634-4a39-a807-4e018784ff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be4945abadc4d6697c7791d316a698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:43Z,use_quota=True,user_id='76b774bda8a5401faea0a2b0bafc6808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53bce51-1abd-4b30-9c3b-da9a00349335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53bce51-1abd-4b30-9c3b-da9a00349335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c485888c-5fec-43b5-8f5c-b1d09b802d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c485888c-5fec-43b5-8f5c-b1d09b802d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112d878b-a634-4a39-a807-4e018784ff3c', 'volume_name': 'volume-112d878b-a634-4a39-a807-4e018784ff3c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68cbbb7-8f8a-4d8d-b2ed-9acd6943e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68cbbb7-8f8a-4d8d-b2ed-9acd6943e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239e3804-7bbd-4977-af81-bddebf257d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Volume 112d878b-a634-4a39-a807-4e018784ff3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112d878b-a634-4a39-a807-4e018784ff3c', 'volume_size': 1} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (5b17e366-c7a2-4de9-ab28-2f50f3693d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:43 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19141aee-8ee2-43aa-a8c0-6f524ed8a988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df" returned: 0 in 0.511s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1532444410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112d878b-a634-4a39-a807-4e018784ff3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7be4945abadc4d6697c7791d316a698f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:43Z,use_quota=True,user_id='76b774bda8a5401faea0a2b0bafc6808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Creating volume 112d878b-a634-4a39-a807-4e018784ff3c {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:43 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19141aee-8ee2-43aa-a8c0-6f524ed8a988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-480168177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8b8176-93bd-4cc9-8448-db068755bdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:43Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f4b8da-8fd2-4593-a7dc-e685488f5b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c 1073741824 Jul 20 16:48:43 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f4b8da-8fd2-4593-a7dc-e685488f5b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a5d595-97b3-492f-8a5e-c44013090d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a5d595-97b3-492f-8a5e-c44013090d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8b8176-93bd-4cc9-8448-db068755bdf7', 'volume_name': 'volume-0c8b8176-93bd-4cc9-8448-db068755bdf7', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3549bd49-1f65-4e2a-988e-d9739de2b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3549bd49-1f65-4e2a-988e-d9739de2b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939247f4-284b-45e4-8810-f8210cd60640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Volume 0c8b8176-93bd-4cc9-8448-db068755bdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8b8176-93bd-4cc9-8448-db068755bdf7', 'volume_size': 1} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361ebbc6-99f4-417c-900f-7fcd856db98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c01eed5-7366-45e7-b845-e6002b0781df', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978dcb5f-49b9-4a21-abe0-e2b6cb784547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Volume volume-4c01eed5-7366-45e7-b845-e6002b0781df (4c01eed5-7366-45e7-b845-e6002b0781df): created successfully Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978dcb5f-49b9-4a21-abe0-e2b6cb784547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (f69b3338-69c2-457d-b904-1a7074255a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:43 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6c528bd1-747b-4b11-9465-7ee781f8524e tempest-CreateVolumesFromImageTest-605154633 None] Created volume successfully. Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (2a3a6b00-a9de-4d14-99f7-57328acbf88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb40969-3618-4094-8c71-736febbf28de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb40969-3618-4094-8c71-736febbf28de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1023057909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e6dbab-d588-4240-b3f8-939f6e1ec2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:44Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ef1c8f-e744-40ca-920f-3113851ff86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ef1c8f-e744-40ca-920f-3113851ff86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0092712b-5e80-46a4-8463-d164c5c3cb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0092712b-5e80-46a4-8463-d164c5c3cb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e6dbab-d588-4240-b3f8-939f6e1ec2d9', 'volume_name': 'volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189999fe-ace4-4dff-90c5-d84904f677ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189999fe-ace4-4dff-90c5-d84904f677ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10587263-4d69-4b03-83bd-40337137f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Volume a7e6dbab-d588-4240-b3f8-939f6e1ec2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9', 'volume_size': 1} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b" returned: 0 in 0.731s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:44 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b Jul 20 16:48:44 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (fbfaf969-ce40-4747-b47c-c0266ee5dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfe9977-f78a-4f01-a322-6d2941311c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfe9977-f78a-4f01-a322-6d2941311c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635890020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f101542-7883-4f76-b024-eb68a20365b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:44Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efce25ab-b5b2-405f-9159-ef066500c2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efce25ab-b5b2-405f-9159-ef066500c2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e229ab-08ea-4574-924a-b6f2a382da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e229ab-08ea-4574-924a-b6f2a382da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f101542-7883-4f76-b024-eb68a20365b4', 'volume_name': 'volume-8f101542-7883-4f76-b024-eb68a20365b4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e91dc0-f863-4446-9f9f-94942444aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e91dc0-f863-4446-9f9f-94942444aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656693ac-66aa-4e42-b584-4f2cc604b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Volume 8f101542-7883-4f76-b024-eb68a20365b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f101542-7883-4f76-b024-eb68a20365b4', 'volume_size': 1} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:44 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c 1073741824" returned: 0 in 0.723s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:44 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c Jul 20 16:48:44 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:44 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3fcb151-68fc-4915-a646-b4904b521a2b" returned: 0 in 0.437s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-quobyte-e3fcb151-68fc-4915-a646-b4904b521a2b" released by "delete_volume" :: held 1.245s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Created reservations ['19b7dd5b-4af9-4df6-9e10-777a7dd1e527', '85209b1e-7179-4491-874b-9846ed3072cd', 'f05861f3-13b6-483b-a3df-cf0ddb2f7c69', '06140999-2228-4468-bc95-6048d809e97e'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:44 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:44 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:44 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (0f85846d-f9e6-4ca3-b4c8-b4fbefe5d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dce132-ed31-48ad-8bb7-918f9d6072dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c" returned: 0 in 0.377s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-480168177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8b8176-93bd-4cc9-8448-db068755bdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:43Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Creating volume 0c8b8176-93bd-4cc9-8448-db068755bdf7 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6dce132-ed31-48ad-8bb7-918f9d6072dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713872083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e63ae-8805-4141-b1dd-e26d864dc052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:45Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1256e92-03be-4874-87df-db17160f36eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 1073741824 Jul 20 16:48:44 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1256e92-03be-4874-87df-db17160f36eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9641365-0b7e-4e02-94d4-d119e5158628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9641365-0b7e-4e02-94d4-d119e5158628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19e63ae-8805-4141-b1dd-e26d864dc052', 'volume_name': 'volume-a19e63ae-8805-4141-b1dd-e26d864dc052', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af4694c-a761-4b29-9494-0fec476c38b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af4694c-a761-4b29-9494-0fec476c38b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b800e84-4736-4e9d-ab17-792ec4e24410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Volume a19e63ae-8805-4141-b1dd-e26d864dc052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19e63ae-8805-4141-b1dd-e26d864dc052', 'volume_size': 1} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239e3804-7bbd-4977-af81-bddebf257d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112d878b-a634-4a39-a807-4e018784ff3c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42b2e10-886c-471a-875b-ceec5b74cb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Volume volume-112d878b-a634-4a39-a807-4e018784ff3c (112d878b-a634-4a39-a807-4e018784ff3c): created successfully Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42b2e10-886c-471a-875b-ceec5b74cb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Flow 'volume_create_manager' (9e4c0571-601c-4a7a-935a-046ce8a4228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-889d93de-ad18-404f-a483-5ef2d90743ae tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Created volume successfully. Jul 20 16:48:44 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Deleted volume successfully. Jul 20 16:48:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe34367-0d89-471f-a274-7d43dc14c86b tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-e3fcb151-68fc-4915-a646-b4904b521a2b-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:45 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 1073741824" returned: 0 in 0.568s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:45 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 Jul 20 16:48:45 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "cinder-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "cinder-quobyte-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-quobyte-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:45 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7" returned: 0 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1023057909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e6dbab-d588-4240-b3f8-939f6e1ec2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:44Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Creating volume a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:45 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d1212-68f1-40d3-9a44-657462f1f82e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:45 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 1073741824 Jul 20 16:48:45 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939247f4-284b-45e4-8810-f8210cd60640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8b8176-93bd-4cc9-8448-db068755bdf7', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b45ff93-0d30-43a7-945a-6022ebd88edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:45 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Volume volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 (0c8b8176-93bd-4cc9-8448-db068755bdf7): created successfully Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b45ff93-0d30-43a7-945a-6022ebd88edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (5b17e366-c7a2-4de9-ab28-2f50f3693d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2ca38c3c-4fe4-41e9-8bc0-25b874114b3d tempest-CreateVolumesFromImageTest-605154633 None] Created volume successfully. Jul 20 16:48:45 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b Jul 20 16:48:45 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:46 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b" returned: 0 in 0.480s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:46 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b Jul 20 16:48:46 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:46 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 1073741824" returned: 0 in 0.567s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Acquiring lock "cinder-112d878b-a634-4a39-a807-4e018784ff3c-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:46 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 Jul 20 16:48:46 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "cinder-112d878b-a634-4a39-a807-4e018784ff3c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Acquiring lock "cinder-quobyte-112d878b-a634-4a39-a807-4e018784ff3c" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "cinder-quobyte-112d878b-a634-4a39-a807-4e018784ff3c" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7388ed4-6c22-46b0-88e4-f8caaa5235f0]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:46 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b" returned: 0 in 0.334s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-quobyte-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b" released by "delete_volume" :: held 0.894s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Created reservations ['77034167-ba7e-419f-a163-540063a68a3d', 'de71e48c-639b-4d8e-9117-5977f76574fb', '204a30d9-c0c6-4d91-9317-3932c3eda02c', 'db5b80ee-726e-4095-80b4-456a25beb05c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:46 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.411s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635890020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f101542-7883-4f76-b024-eb68a20365b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:44Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Creating volume 8f101542-7883-4f76-b024-eb68a20365b4 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:46 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:46 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c Jul 20 16:48:46 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10587263-4d69-4b03-83bd-40337137f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:46 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 1073741824 Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358de774-3d2f-4b4a-a9e8-8fe7cac6a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:46 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:46 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Volume volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 (a7e6dbab-d588-4240-b3f8-939f6e1ec2d9): created successfully Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358de774-3d2f-4b4a-a9e8-8fe7cac6a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (2a3a6b00-a9de-4d14-99f7-57328acbf88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-764ef0b3-edce-4c47-883b-6385c2c2ce47 tempest-CreateVolumesFromImageTest-605154633 None] Created volume successfully. Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:46 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:46 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:47 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c" returned: 0 in 0.552s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:47 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c Jul 20 16:48:47 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:47 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.295s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Deleted volume successfully. Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d6f6ca7-83f4-4592-bfd9-1390c82d9cc4 tempest-AttachVolumeNegativeTest-1042691458 None] Lock "cinder-981eeb4b-6de0-4fc4-92b0-d1d8da6a1f4b-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:47 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 1073741824" returned: 0 in 0.550s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:47 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 Jul 20 16:48:47 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:47 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-112d878b-a634-4a39-a807-4e018784ff3c" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "cinder-quobyte-112d878b-a634-4a39-a807-4e018784ff3c" released by "delete_volume" :: held 0.887s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Created reservations ['fc16a74b-a6e3-49c6-a35f-3636cb693534', 'd98f21b8-63b7-4d70-bd34-09e48df9ac5b', '263952cf-fb31-4738-b490-6005ddda2e4f', '2c35f9b2-67f4-475b-b141-18287df728b2'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:47 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:47 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:47 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.804s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713872083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e63ae-8805-4141-b1dd-e26d864dc052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14cbaba2e84417d9404a8e335ab440b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:45Z,use_quota=True,user_id='68c5fb2010674b018af90e053f066454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Creating volume a19e63ae-8805-4141-b1dd-e26d864dc052 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:47 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656693ac-66aa-4e42-b584-4f2cc604b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f101542-7883-4f76-b024-eb68a20365b4', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:47 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 1073741824 Jul 20 16:48:47 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37336ada-8f8c-428c-b75d-7e8ee1c1bb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:47 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Volume volume-8f101542-7883-4f76-b024-eb68a20365b4 (8f101542-7883-4f76-b024-eb68a20365b4): created successfully Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37336ada-8f8c-428c-b75d-7e8ee1c1bb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (fbfaf969-ce40-4747-b47c-c0266ee5dced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c4a7025c-d83c-4bf2-8df6-43a256a23ca2 tempest-CreateVolumesFromImageTest-605154633 None] Created volume successfully. Jul 20 16:48:47 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.279s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Deleted volume successfully. Jul 20 16:48:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-130c00a8-9a25-4c4e-8d7a-e1dac4ce0231 tempest-VolumeQuotasNegativeTestJSON-1194387836 None] Lock "cinder-112d878b-a634-4a39-a807-4e018784ff3c-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:48 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 1073741824" returned: 0 in 0.584s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:48 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 Jul 20 16:48:48 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Flow 'volume_create_manager' (cd6d5628-6222-42c5-a6ca-8fc4b7f0e23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3054a54-09c3-41e0-bd86-9349799b66eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3054a54-09c3-41e0-bd86-9349799b66eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-294976186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc50cdf-64b5-4ef5-9e06-188e62e03ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8d85f834f48ec8497550a814b5036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:48Z,use_quota=True,user_id='2eb35ba776374b538b49cca6b9953627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4a8c24-2ed4-430a-95f0-c115671bbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4a8c24-2ed4-430a-95f0-c115671bbfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86aa9dd-7eb8-442a-b88d-b23128754596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:48:48 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052" returned: 0 in 0.261s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b800e84-4736-4e9d-ab17-792ec4e24410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19e63ae-8805-4141-b1dd-e26d864dc052', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3561d917-1541-4320-8107-4138d2ced0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:48 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Volume volume-a19e63ae-8805-4141-b1dd-e26d864dc052 (a19e63ae-8805-4141-b1dd-e26d864dc052): created successfully Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3561d917-1541-4320-8107-4138d2ced0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Flow 'volume_create_manager' (0f85846d-f9e6-4ca3-b4c8-b4fbefe5d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a52b1c66-b12b-492f-bfb2-cef1d052aacf tempest-CreateVolumesFromImageTest-605154633 None] Created volume successfully. Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86aa9dd-7eb8-442a-b88d-b23128754596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bc50cdf-64b5-4ef5-9e06-188e62e03ffb', 'volume_name': 'volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc3e75-5dff-4d41-a5d2-6f68c6cbe970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dc3e75-5dff-4d41-a5d2-6f68c6cbe970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c11d2c7-216a-4fa6-bbe6-fac1e9e59649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:48 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Volume 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 20 16:48:48 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Trying to clone 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb from image aa995944-e655-43b4-81e9-d04027d5b275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:48:49 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Image download 20.69 MB at 20.69 MB/s Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[534ce2a2-e28f-47cd-9985-33cb76113f9d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-a19e63ae-8805-4141-b1dd-e26d864dc052-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:49 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD Jul 20 16:48:49 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-a19e63ae-8805-4141-b1dd-e26d864dc052-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-quobyte-a19e63ae-8805-4141-b1dd-e26d864dc052" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-a19e63ae-8805-4141-b1dd-e26d864dc052" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dda4ec-7ee6-493c-bccb-06103fb45e84]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:49 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 is fetched for user 2eb35ba776374b538b49cca6b9953627. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:48:49 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 Jul 20 16:48:49 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd187c-6156-4f0a-87f1-7568e04997c8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:49 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD Jul 20 16:48:49 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:50 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052" returned: 0 in 0.492s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:50 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052 Jul 20 16:48:50 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:50 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-294976186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc50cdf-64b5-4ef5-9e06-188e62e03ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8d85f834f48ec8497550a814b5036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:48:48Z,use_quota=True,user_id='2eb35ba776374b538b49cca6b9953627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Creating volume 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:48:50 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:50 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb 1073741824 Jul 20 16:48:50 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:50 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a19e63ae-8805-4141-b1dd-e26d864dc052" returned: 0 in 0.304s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-a19e63ae-8805-4141-b1dd-e26d864dc052" released by "delete_volume" :: held 0.865s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Created reservations ['746310d3-9c85-4a73-98f2-59477c7eedc1', '94232748-3984-44ec-a155-c9a1973682b9', '2d02e73c-43a6-4a6f-b972-55a32b9dc81b', '298e38ae-4f58-41c8-a37d-8a69b1574e6a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:50 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:50 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-8f101542-7883-4f76-b024-eb68a20365b4-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-8f101542-7883-4f76-b024-eb68a20365b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-quobyte-8f101542-7883-4f76-b024-eb68a20365b4" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-8f101542-7883-4f76-b024-eb68a20365b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc9e3c1-e171-41b3-bb9d-5660ecf6d2eb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:50 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:50 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Deleted volume successfully. Jul 20 16:48:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9dc99bb0-3cfd-4e3d-a13b-caa35e10625a tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-a19e63ae-8805-4141-b1dd-e26d864dc052-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:50 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 Jul 20 16:48:50 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:51 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb 1073741824" returned: 0 in 0.768s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:51 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb Jul 20 16:48:51 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:51 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4" returned: 0 in 0.584s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:51 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:51 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4 Jul 20 16:48:51 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" returned: 0 in 0.338s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Attempting download of aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4fd303-7f59-4b40-817b-953c88f03a61]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:51 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f101542-7883-4f76-b024-eb68a20365b4" returned: 0 in 0.310s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-8f101542-7883-4f76-b024-eb68a20365b4" released by "delete_volume" :: held 0.945s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:51 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76 Jul 20 16:48:51 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Created reservations ['78f5da5b-af7c-4cc9-9de4-7526271d593b', 'c4580fa0-e8c1-4c07-96fe-7d2395614d88', '0cc6b3f1-a73d-4f40-b14d-48c9cece36b1', '05253030-6b6d-4fc0-8f9c-a73523e2a4f8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:52 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:52 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:52 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76" returned: 0 in 0.542s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-quobyte-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1118d2d1-9ba7-4692-9dea-2c2b97402ae2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:52 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76 Jul 20 16:48:52 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:52 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.314s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Deleted volume successfully. Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0ad61b58-5efd-4efe-8e33-3305cf86587e tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-8f101542-7883-4f76-b024-eb68a20365b4-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:52 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 Jul 20 16:48:52 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:52 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76" returned: 1 in 0.457s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_9ext6u76' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f642a2-0e4f-4629-89e4-34630611afb1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:52 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD Jul 20 16:48:52 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:52 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9" returned: 0 in 0.544s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:52 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9 Jul 20 16:48:52 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:53 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] aa995944-e655-43b4-81e9-d04027d5b275 was qcow2, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:53 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb Jul 20 16:48:53 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:53 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9" returned: 0 in 0.387s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9" released by "delete_volume" :: held 1.005s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Created reservations ['757845a3-0892-418c-a5be-8562427094c2', '10f23da1-25c7-42a3-98b0-705c37a87da3', '0451e32c-a243-4261-ba84-3a3fef95c71a', '9e64f7ca-9aff-4012-a270-3ba1e79fe0ef'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:53 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:53 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:53 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:53 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Deleted volume successfully. Jul 20 16:48:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4e0a51ff-eac2-44f4-986c-b9ca9a671599 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-a7e6dbab-d588-4240-b3f8-939f6e1ec2d9-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-0c8b8176-93bd-4cc9-8448-db068755bdf7-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-0c8b8176-93bd-4cc9-8448-db068755bdf7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-quobyte-0c8b8176-93bd-4cc9-8448-db068755bdf7" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-0c8b8176-93bd-4cc9-8448-db068755bdf7" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:54 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[60843bda-c391-42c1-8479-0c4fe35a1bfd]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:54 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 Jul 20 16:48:54 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:54 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7" returned: 0 in 0.425s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:55 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7 Jul 20 16:48:55 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:55 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" returned: 0 in 2.213s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_4uqaywr5devstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:48:55 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Converted 112.00 MB image at 50.55 MB/s Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:55 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb 1G Jul 20 16:48:55 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:55 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0c8b8176-93bd-4cc9-8448-db068755bdf7" returned: 0 in 0.321s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-0c8b8176-93bd-4cc9-8448-db068755bdf7" released by "delete_volume" :: held 0.815s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Created reservations ['7307fa6c-7510-44a4-9cea-d4f98ec61c44', '3e35f4e9-6957-4425-8ce7-55a78e6f266f', 'fe584525-7f22-4bf6-bf31-9dab5c2010be', '2d491242-8d1a-45a9-a2c6-1cae8886452b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:55 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:55 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:55 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-4c01eed5-7366-45e7-b845-e6002b0781df-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb 1G" returned: 0 in 0.414s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Downloaded image aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 for user 2eb35ba776374b538b49cca6b9953627 is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Marking volume 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-4c01eed5-7366-45e7-b845-e6002b0781df-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Copying metadata from image aa995944-e655-43b4-81e9-d04027d5b275 to 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Creating volume glance metadata for volume 9bc50cdf-64b5-4ef5-9e06-188e62e03ffb backed by image aa995944-e655-43b4-81e9-d04027d5b275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "cinder-quobyte-4c01eed5-7366-45e7-b845-e6002b0781df" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-4c01eed5-7366-45e7-b845-e6002b0781df" acquired by "delete_volume" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a949d-e5fb-423b-ae09-6ab6f7be4690]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:55 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.347s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Deleted volume successfully. Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fff23df6-6f6c-451e-b567-c26f29bb5d2b tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-0c8b8176-93bd-4cc9-8448-db068755bdf7-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c11d2c7-216a-4fa6-bbe6-fac1e9e59649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79133561-2cf1-4eeb-b364-e051c11f1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:48:55 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Volume volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb (9bc50cdf-64b5-4ef5-9e06-188e62e03ffb): created successfully Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79133561-2cf1-4eeb-b364-e051c11f1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:48:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Flow 'volume_create_manager' (cd6d5628-6222-42c5-a6ca-8fc4b7f0e23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:48:55 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df Jul 20 16:48:55 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9bbcd215-185f-456b-adcd-48a96029c43c tempest-VolumesImageMetadata-1499336355 None] Created volume successfully. Jul 20 16:48:56 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df" returned: 0 in 0.408s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:56 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df Jul 20 16:48:56 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:56 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4c01eed5-7366-45e7-b845-e6002b0781df" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-quobyte-4c01eed5-7366-45e7-b845-e6002b0781df" released by "delete_volume" :: held 0.730s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Created reservations ['044b99aa-368f-4ed8-8677-117a22246c07', '05eb6d2d-11d0-4dc2-a823-6b730060b0be', 'ce4bcfd1-7af9-4af1-af91-c12fc274436d', '0f6a4a80-f8ac-436f-9370-aaf6a562f0c7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:56 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:56 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:56 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.269s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Deleted volume successfully. Jul 20 16:48:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ad398ad8-5560-4dc4-9075-1d3fb42d1112 tempest-CreateVolumesFromImageTest-605154633 None] Lock "cinder-4c01eed5-7366-45e7-b845-e6002b0781df-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Acquiring lock "cinder-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Lock "cinder-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Acquiring lock "cinder-quobyte-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:48:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Lock "cinder-quobyte-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:48:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0cf6b0-6d65-4881-95d1-077f8a027531]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:48:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:57 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb Jul 20 16:48:57 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:58 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" returned: 0 in 0.581s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:58 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb Jul 20 16:48:58 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:58 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Lock "cinder-quobyte-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb" released by "delete_volume" :: held 1.005s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Created reservations ['c001cbfb-7005-42fe-ade8-0a06c9c16bb9', '75c50f7a-0ce8-435f-bb1c-d4d4ddd789a0', '02755ecc-a779-4df2-a938-bd53aaa39bfe', '6deb41ad-3abb-40ae-8ea9-c9e40b8a1730'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:48:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:48:58 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:48:58 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:48:59 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Jul 20 16:48:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:48:59 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:48:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Deleted volume successfully. Jul 20 16:48:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-391b6946-9ed8-44b8-a4f8-86b45f5d0a19 tempest-VolumesImageMetadata-1499336355 None] Lock "cinder-9bc50cdf-64b5-4ef5-9e06-188e62e03ffb-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (9e54ac53-0078-46ac-a24a-59fd18680b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f7d0ba-d9dd-4393-be72-73c407168c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f7d0ba-d9dd-4393-be72-73c407168c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841637110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04755e48-deec-4281-9be9-464d34ed0628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:01Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfdf439-e912-4a9c-877e-c58e4563c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfdf439-e912-4a9c-877e-c58e4563c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2d2d81-ecce-4c43-8632-e41960534947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2d2d81-ecce-4c43-8632-e41960534947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04755e48-deec-4281-9be9-464d34ed0628', 'volume_name': 'volume-04755e48-deec-4281-9be9-464d34ed0628', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8979dc30-3606-4ce9-8964-3866de375626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8979dc30-3606-4ce9-8964-3866de375626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11964a8d-01de-44dc-aaa2-5d6995529ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume 04755e48-deec-4281-9be9-464d34ed0628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04755e48-deec-4281-9be9-464d34ed0628', 'volume_size': 1} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841637110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04755e48-deec-4281-9be9-464d34ed0628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:01Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Creating volume 04755e48-deec-4281-9be9-464d34ed0628 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:01 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:01 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 1073741824 Jul 20 16:49:01 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:01 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 1073741824" returned: 0 in 0.584s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:01 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 Jul 20 16:49:01 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:02 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628" returned: 0 in 0.403s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11964a8d-01de-44dc-aaa2-5d6995529ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04755e48-deec-4281-9be9-464d34ed0628', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ef0150-6524-457a-aa98-5cf35c8ee8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume volume-04755e48-deec-4281-9be9-464d34ed0628 (04755e48-deec-4281-9be9-464d34ed0628): created successfully Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ef0150-6524-457a-aa98-5cf35c8ee8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (9e54ac53-0078-46ac-a24a-59fd18680b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-febca8ea-9739-4ab2-8a1d-6a2eafac63e9 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created volume successfully. Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (1b6be8bd-e3da-495b-a51e-1f676f31412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51472a0d-13a1-4fc0-ae97-24b6cc2a5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51472a0d-13a1-4fc0-ae97-24b6cc2a5a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772173654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:04Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7999317a-fa63-4940-a82b-8c37ba60ba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7999317a-fa63-4940-a82b-8c37ba60ba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc9b528-a764-411d-a3db-0ae16897a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc9b528-a764-411d-a3db-0ae16897a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f', 'volume_name': 'volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f83b4-71fb-4880-a501-90bd536682b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f83b4-71fb-4880-a501-90bd536682b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37bf74-0cd4-4013-9339-5c00833e8039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:03 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume 7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f', 'volume_size': 1} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772173654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:04Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Creating volume 7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:03 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:03 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f 1073741824 Jul 20 16:49:03 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (baf1484a-6f5f-4360-866f-27d425c554fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d7cda0-679e-4cf9-ae79-ba3ea147673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d7cda0-679e-4cf9-ae79-ba3ea147673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535462787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976dff2d-74eb-4a50-8772-ff47bfc27eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:04Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d35201-8c00-4cdd-91b1-8a6c92f5177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d35201-8c00-4cdd-91b1-8a6c92f5177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2833bb5-f059-40dd-b092-5ea23e93232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2833bb5-f059-40dd-b092-5ea23e93232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976dff2d-74eb-4a50-8772-ff47bfc27eb1', 'volume_name': 'volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145d7dfa-35f7-4ed6-bfaf-878e1c0fde38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145d7dfa-35f7-4ed6-bfaf-878e1c0fde38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242ad04-890e-4736-9c7d-501e4cf04f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume 976dff2d-74eb-4a50-8772-ff47bfc27eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1', 'volume_size': 1} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d020e6ff-cab3-4c35-8225-2871ab7ed512 tempest-GroupSnapshotsTest-835633462 None] Group tempest-GroupSnapshotsTest-Group-692147963: creating Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d020e6ff-cab3-4c35-8225-2871ab7ed512 tempest-GroupSnapshotsTest-835633462 None] Group tempest-GroupSnapshotsTest-Group-692147963: created successfully Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d020e6ff-cab3-4c35-8225-2871ab7ed512 tempest-GroupSnapshotsTest-835633462 None] Create group completed successfully. Jul 20 16:49:04 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f 1073741824" returned: 0 in 0.665s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:04 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f Jul 20 16:49:04 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:04 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f" returned: 0 in 0.364s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535462787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976dff2d-74eb-4a50-8772-ff47bfc27eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:04Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Creating volume 976dff2d-74eb-4a50-8772-ff47bfc27eb1 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb37bf74-0cd4-4013-9339-5c00833e8039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:04 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 1073741824 Jul 20 16:49:04 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b0037f-2abd-4b42-a77a-e5b470a50f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f (7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f): created successfully Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b0037f-2abd-4b42-a77a-e5b470a50f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (1b6be8bd-e3da-495b-a51e-1f676f31412f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8b4991f1-b085-4bf7-b3e7-eaf6b945762b tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created volume successfully. Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=178,cinder:INSERT=61,cinder:UPDATE=189,cinder:DELETE=18 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (4f06aa28-fe45-4591-98e5-f5d7bddbc90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6229c02-b4a2-4921-a6c9-28f52b22dd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6229c02-b4a2-4921-a6c9-28f52b22dd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510595457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7124b1bb-d0f0-4539-9d68-034ac72e186e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:05Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8afa5bc-4b56-4c44-a850-3a72981e054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8afa5bc-4b56-4c44-a850-3a72981e054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400cb8f2-cbd1-4b11-9781-1de4cfc92979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400cb8f2-cbd1-4b11-9781-1de4cfc92979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7124b1bb-d0f0-4539-9d68-034ac72e186e', 'volume_name': 'volume-7124b1bb-d0f0-4539-9d68-034ac72e186e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e746a5-0550-48dd-a53e-a21aa96cb853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e746a5-0550-48dd-a53e-a21aa96cb853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a67283a-de3c-4b70-87eb-86fb14154758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume 7124b1bb-d0f0-4539-9d68-034ac72e186e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7124b1bb-d0f0-4539-9d68-034ac72e186e', 'volume_size': 1} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Flow 'volume_create_manager' (1df53d40-4cbe-4c4b-80b1-ee11d06cf185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4532c7cd-a188-44ac-aec7-c73064451d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=161,cinder:UPDATE=225,cinder:DELETE=13,cinder:INSERT=43 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4532c7cd-a188-44ac-aec7-c73064451d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135800030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2f7ce-eb9c-4449-a72f-f145ef5823a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14230aa78f434782aa92bc4a4d40f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:05Z,use_quota=True,user_id='e554e2926b3b4b93a946430688e3b009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16aff0fd-08aa-4144-b8a1-0c72b311d96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16aff0fd-08aa-4144-b8a1-0c72b311d96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b59b5f3-adc9-4e7c-9bda-33f9807a5c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b59b5f3-adc9-4e7c-9bda-33f9807a5c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed2f7ce-eb9c-4449-a72f-f145ef5823a7', 'volume_name': 'volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d940db00-0776-46fd-be8a-0227e29f966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d940db00-0776-46fd-be8a-0227e29f966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c019a2-eaf6-45d3-ab0e-697e4937750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Volume 9ed2f7ce-eb9c-4449-a72f-f145ef5823a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7', 'volume_size': 1} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:05 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 1073741824" returned: 0 in 0.771s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:05 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 Jul 20 16:49:05 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (d8c59cc8-d2a6-4f77-bb41-fef138d35867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e65066-8f4a-482e-b03e-7104909bb7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:05 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1" returned: 0 in 0.334s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1510595457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7124b1bb-d0f0-4539-9d68-034ac72e186e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:05Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Creating volume 7124b1bb-d0f0-4539-9d68-034ac72e186e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e65066-8f4a-482e-b03e-7104909bb7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1459307380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e427968-fb50-4b2d-937d-3a097a2caca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:06Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0392006b-95d8-410b-9eed-29e8e852f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e 1073741824 Jul 20 16:49:06 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0392006b-95d8-410b-9eed-29e8e852f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c09591a-53de-4a96-8286-126900118411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c09591a-53de-4a96-8286-126900118411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e427968-fb50-4b2d-937d-3a097a2caca3', 'volume_name': 'volume-7e427968-fb50-4b2d-937d-3a097a2caca3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76de64c1-8bae-41a5-965d-8db1aff58e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76de64c1-8bae-41a5-965d-8db1aff58e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba462e33-4e6f-470b-9986-7105c99caa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume 7e427968-fb50-4b2d-937d-3a097a2caca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e427968-fb50-4b2d-937d-3a097a2caca3', 'volume_size': 1} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242ad04-890e-4736-9c7d-501e4cf04f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d570248-9373-41dd-b418-7a9a2a9b3127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (82094e77-11c1-4162-95e5-96bbb0e9d1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45794ad-c59f-407f-bb1d-9ecf242badec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 (976dff2d-74eb-4a50-8772-ff47bfc27eb1): created successfully Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d570248-9373-41dd-b418-7a9a2a9b3127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (baf1484a-6f5f-4360-866f-27d425c554fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45794ad-c59f-407f-bb1d-9ecf242badec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2012610710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c9f22d6-de9a-43ec-9b2f-12fc6ad8b9a8,host='devstack@QuobyteHD#QuobyteHD',id=6a2c52af-fe64-4291-9d5c-014bb836ca71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:06Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c6d88f9-0e45-45f2-8080-0e89d113a53f),volume_type_id=8c6d88f9-0e45-45f2-8080-0e89d113a53f)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697fb061-3965-43cb-bfb9-7553d25b50dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697fb061-3965-43cb-bfb9-7553d25b50dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01547449-3415-4924-ae8e-bd7d3485d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01547449-3415-4924-ae8e-bd7d3485d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2c52af-fe64-4291-9d5c-014bb836ca71', 'volume_name': 'volume-6a2c52af-fe64-4291-9d5c-014bb836ca71', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b94873d-7d0b-47bc-9ffc-ccfda010f212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b94873d-7d0b-47bc-9ffc-ccfda010f212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8071cead-737b-4a32-8ff9-a93402545420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Volume 6a2c52af-fe64-4291-9d5c-014bb836ca71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2c52af-fe64-4291-9d5c-014bb836ca71', 'volume_size': 1} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (5216d472-e1fb-4b05-9745-edf25c64dca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04b1054-ed74-4710-aae8-8d976322ce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4edbc894-fbc1-4134-89e0-7dbbc3a7faca tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created volume successfully. Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04b1054-ed74-4710-aae8-8d976322ce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139776730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d082b620-dc54-4711-bec6-241a885576ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:06Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edfb9d5d-9aaf-43bb-97ab-7b54aca2d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edfb9d5d-9aaf-43bb-97ab-7b54aca2d76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07b6962-697b-4102-ab03-633118772223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07b6962-697b-4102-ab03-633118772223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd082b620-dc54-4711-bec6-241a885576ae', 'volume_name': 'volume-d082b620-dc54-4711-bec6-241a885576ae', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476fc802-5571-45a0-b546-89ab2347b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476fc802-5571-45a0-b546-89ab2347b553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e35fd2-59b8-44ac-9c98-f3831694a793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume d082b620-dc54-4711-bec6-241a885576ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d082b620-dc54-4711-bec6-241a885576ae', 'volume_size': 1} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:06 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e 1073741824" returned: 0 in 0.579s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:06 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e Jul 20 16:49:06 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:06 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135800030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2f7ce-eb9c-4449-a72f-f145ef5823a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14230aa78f434782aa92bc4a4d40f376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:05Z,use_quota=True,user_id='e554e2926b3b4b93a946430688e3b009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Creating volume 9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a67283a-de3c-4b70-87eb-86fb14154758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7124b1bb-d0f0-4539-9d68-034ac72e186e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27229372-7ef5-485d-8fa5-9f4df1282712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:06 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 1073741824 Jul 20 16:49:06 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume volume-7124b1bb-d0f0-4539-9d68-034ac72e186e (7124b1bb-d0f0-4539-9d68-034ac72e186e): created successfully Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27229372-7ef5-485d-8fa5-9f4df1282712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (4f06aa28-fe45-4591-98e5-f5d7bddbc90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-61f6e99d-23d1-40ae-b96a-2218837d6663 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created volume successfully. Jul 20 16:49:07 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 1073741824" returned: 0 in 0.528s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:07 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 Jul 20 16:49:07 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:07 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" returned: 0 in 0.255s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1459307380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e427968-fb50-4b2d-937d-3a097a2caca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:06Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Creating volume 7e427968-fb50-4b2d-937d-3a097a2caca3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:07 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c019a2-eaf6-45d3-ab0e-697e4937750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:07 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 1073741824 Jul 20 16:49:07 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d87b657-1c47-4b17-a1e9-fd939238023a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Volume volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 (9ed2f7ce-eb9c-4449-a72f-f145ef5823a7): created successfully Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d87b657-1c47-4b17-a1e9-fd939238023a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Flow 'volume_create_manager' (1df53d40-4cbe-4c4b-80b1-ee11d06cf185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-248ae56c-c2f8-4a6c-8107-88da4049a519 tempest-SnapshotMetadataTestJSON-2126176047 None] Created volume successfully. Jul 20 16:49:08 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 1073741824" returned: 0 in 0.442s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:08 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 Jul 20 16:49:08 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:08 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2c9f22d6-de9a-43ec-9b2f-12fc6ad8b9a8,created_at=2026-07-20T14:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2012610710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2c9f22d6-de9a-43ec-9b2f-12fc6ad8b9a8,host='devstack@QuobyteHD#QuobyteHD',id=6a2c52af-fe64-4291-9d5c-014bb836ca71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:06Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c6d88f9-0e45-45f2-8080-0e89d113a53f),volume_type_id=8c6d88f9-0e45-45f2-8080-0e89d113a53f)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Creating volume 6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:08 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba462e33-4e6f-470b-9986-7105c99caa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e427968-fb50-4b2d-937d-3a097a2caca3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f50a43d-3e37-4a65-a37d-e78da552b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:08 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 1073741824 Jul 20 16:49:08 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:08 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume volume-7e427968-fb50-4b2d-937d-3a097a2caca3 (7e427968-fb50-4b2d-937d-3a097a2caca3): created successfully Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f50a43d-3e37-4a65-a37d-e78da552b89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (d8c59cc8-d2a6-4f77-bb41-fef138d35867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-52b4d239-15fb-4ca4-8d04-cfd5f6a485ea tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created volume successfully. Jul 20 16:49:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:09 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 1073741824" returned: 0 in 0.564s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:09 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:09 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:09 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.254s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.949s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139776730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d082b620-dc54-4711-bec6-241a885576ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9691c4ca14e0185bc26c8ca5e7ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:06Z,use_quota=True,user_id='ae3aadcec6024eaf86289f6fa031ad78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Creating volume d082b620-dc54-4711-bec6-241a885576ae {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:09 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8071cead-737b-4a32-8ff9-a93402545420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2c52af-fe64-4291-9d5c-014bb836ca71', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6840c4fe-ff0a-42b6-af6b-f3946b297c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:09 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae 1073741824 Jul 20 16:49:09 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Volume volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 (6a2c52af-fe64-4291-9d5c-014bb836ca71): created successfully Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6840c4fe-ff0a-42b6-af6b-f3946b297c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (82094e77-11c1-4162-95e5-96bbb0e9d1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5fdb494d-6149-4a23-b94b-6e2b1a5b8fcc tempest-GroupSnapshotsTest-835633462 None] Created volume successfully. Jul 20 16:49:09 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae 1073741824" returned: 0 in 0.450s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:09 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae Jul 20 16:49:09 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:10 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae" returned: 0 in 0.242s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.205s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e35fd2-59b8-44ac-9c98-f3831694a793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d082b620-dc54-4711-bec6-241a885576ae', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a9d50a-b680-43ae-893a-edbb1ba52db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Creating offline snapshot fb90e3ce-090f-46a8-b289-912412c92ade of volume 9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:10 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Volume volume-d082b620-dc54-4711-bec6-241a885576ae (d082b620-dc54-4711-bec6-241a885576ae): created successfully Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a9d50a-b680-43ae-893a-edbb1ba52db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Flow 'volume_create_manager' (5216d472-e1fb-4b05-9745-edf25c64dca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f926e93-4ab5-4095-bf64-bb958c227ffe]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:10 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4c6f103e-2351-4a79-b361-6c24480305cb tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created volume successfully. Jul 20 16:49:10 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 Jul 20 16:49:10 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:10 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" returned: 0 in 0.422s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:10 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade 1G Jul 20 16:49:10 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Flow 'volume_create_manager' (1f461227-7c07-4b98-936f-2a117e13e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1777b7-f5a3-430e-88c4-af21d941ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-d082b620-dc54-4711-bec6-241a885576ae-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1777b7-f5a3-430e-88c4-af21d941ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1805591180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee900f1-db8b-40ca-8c76-09b681cd7baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0908f753d849bca3952191f9fc4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:11Z,use_quota=True,user_id='577aafccdffb4cb8b22ea659d02752c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0477073c-23a5-4c69-a7dd-38aff4a3d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0477073c-23a5-4c69-a7dd-38aff4a3d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59eb4767-9b34-4d80-acb8-32fea2b6d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59eb4767-9b34-4d80-acb8-32fea2b6d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee900f1-db8b-40ca-8c76-09b681cd7baf', 'volume_name': 'volume-fee900f1-db8b-40ca-8c76-09b681cd7baf', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee3161e-a6cc-457e-a3b0-c51455f1b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee3161e-a6cc-457e-a3b0-c51455f1b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a367444-4de4-46df-ab96-4560b4a86d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:10 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Volume fee900f1-db8b-40ca-8c76-09b681cd7baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee900f1-db8b-40ca-8c76-09b681cd7baf', 'volume_size': 1} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-d082b620-dc54-4711-bec6-241a885576ae-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:10 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] GroupSnapshot 918d83a7-8220-4eec-9693-3390701734b5: creating. Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-quobyte-d082b620-dc54-4711-bec6-241a885576ae" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-d082b620-dc54-4711-bec6-241a885576ae" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Group snapshot 918d83a7-8220-4eec-9693-3390701734b5: creating. {{(pid=87535) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde1d8a9-57c4-47db-b352-b23b33810fa3]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:11 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:11 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae Jul 20 16:49:11 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade 1G" returned: 0 in 0.505s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:11 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade Jul 20 16:49:11 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:11 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae" returned: 0 in 0.363s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:11 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae Jul 20 16:49:11 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:11 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade is being set with open permissions: ugo+rw Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:11 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade Jul 20 16:49:11 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:11 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d082b620-dc54-4711-bec6-241a885576ae" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-d082b620-dc54-4711-bec6-241a885576ae" released by "delete_volume" :: held 0.678s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:11 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade" returned: 0 in 0.248s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created reservations ['7f674bb6-d55b-4cfc-88c6-75a6feb609ac', '73202e29-3a93-4bfe-a578-ba01d67ffadd', 'e6fa2c16-bbd1-4ec7-a4ef-6a78df690eaf', 'a78de082-9dc5-47fd-b198-552b17d1d2da'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:11 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info Jul 20 16:49:11 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:11 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:11 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:11 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info is being set with open permissions: ugo+rw Jul 20 16:49:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-7e427968-fb50-4b2d-937d-3a097a2caca3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:12 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info Jul 20 16:49:12 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-7e427968-fb50-4b2d-937d-3a097a2caca3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-quobyte-7e427968-fb50-4b2d-937d-3a097a2caca3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:12 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.291s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-7e427968-fb50-4b2d-937d-3a097a2caca3" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Deleted volume successfully. Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccea3174-18c8-4bac-875d-333b1a5a6499]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ed3fb5a4-d9e6-413c-84b0-b486b43f09e5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-d082b620-dc54-4711-bec6-241a885576ae-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:12 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 Jul 20 16:49:12 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:12 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.info" returned: 0 in 0.296s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.401s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1805591180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee900f1-db8b-40ca-8c76-09b681cd7baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0908f753d849bca3952191f9fc4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:11Z,use_quota=True,user_id='577aafccdffb4cb8b22ea659d02752c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Creating volume fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:12 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:12 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf 1073741824 Jul 20 16:49:12 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-fab5620c-c991-4682-a7a0-9ac580849a8d tempest-SnapshotMetadataTestJSON-2126176047 None] Create snapshot completed successfully Jul 20 16:49:12 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3" returned: 0 in 0.361s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:12 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3 Jul 20 16:49:12 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:12 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf 1073741824" returned: 0 in 0.426s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:12 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e427968-fb50-4b2d-937d-3a097a2caca3" returned: 0 in 0.278s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-7e427968-fb50-4b2d-937d-3a097a2caca3" released by "delete_volume" :: held 0.690s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:12 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:12 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created reservations ['d227abe8-314e-4444-8e6d-b911d7f2cfb5', '5fb101a3-e5c2-4e95-a654-cee8d9c4daad', '093c793d-aa83-4867-987f-be058a42e01f', 'ca0fb755-682b-4716-a8e0-2e5d2f487ed7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:12 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:12 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:12 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Creating offline snapshot db39f379-1b21-423d-8f54-88982a1d8a24 of volume 6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a367444-4de4-46df-ab96-4560b4a86d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee900f1-db8b-40ca-8c76-09b681cd7baf', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b345dd-c766-4bf4-8c31-0100763ce922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704640a-20b1-4a2c-85b5-764c7587578d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Volume volume-fee900f1-db8b-40ca-8c76-09b681cd7baf (fee900f1-db8b-40ca-8c76-09b681cd7baf): created successfully Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b345dd-c766-4bf4-8c31-0100763ce922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Flow 'volume_create_manager' (1f461227-7c07-4b98-936f-2a117e13e59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-97ae8f6d-4e34-4fce-b3d6-7941e64c1d15 tempest-VolumesDeleteCascade-1358072704 None] Created volume successfully. Jul 20 16:49:13 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.303s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Deleted volume successfully. Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-7124b1bb-d0f0-4539-9d68-034ac72e186e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:13 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:13 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43183983-0612-42e6-92b8-a71ca2d365a5 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-7e427968-fb50-4b2d-937d-3a097a2caca3-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-7124b1bb-d0f0-4539-9d68-034ac72e186e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-quobyte-7124b1bb-d0f0-4539-9d68-034ac72e186e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-7124b1bb-d0f0-4539-9d68-034ac72e186e" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f4a6b-cb48-4efc-904c-1e4297d8c9ee]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:13 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e Jul 20 16:49:13 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:13 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.464s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:13 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 1G Jul 20 16:49:13 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:13 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e" returned: 0 in 0.453s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:13 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e Jul 20 16:49:13 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "cinder-fb90e3ce-090f-46a8-b289-912412c92ade-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-fb90e3ce-090f-46a8-b289-912412c92ade-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "cinder-quobyte-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-quobyte-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "cinder-quobyte-fb90e3ce-090f-46a8-b289-912412c92ade" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-quobyte-fb90e3ce-090f-46a8-b289-912412c92ade" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Deleting offline snapshot fb90e3ce-090f-46a8-b289-912412c92ade of volume 9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] snapshot_file for this snap is: volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:14 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bfadf4-e670-419d-a3ce-87afd6f16cd8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 1G" returned: 0 in 0.644s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:14 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 Jul 20 16:49:14 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7124b1bb-d0f0-4539-9d68-034ac72e186e" returned: 0 in 0.407s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-7124b1bb-d0f0-4539-9d68-034ac72e186e" released by "delete_volume" :: held 0.907s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:14 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade Jul 20 16:49:14 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created reservations ['3deff113-7125-4476-9409-239dfb5802de', '10b62b9b-b2ab-4e64-89db-22dc42962bee', '2f76a782-d433-42c3-b54c-c89129e6569f', 'e438b1b3-067d-4cd7-a43f-8c142ae2893d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:14 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-976dff2d-74eb-4a50-8772-ff47bfc27eb1-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-976dff2d-74eb-4a50-8772-ff47bfc27eb1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-quobyte-976dff2d-74eb-4a50-8772-ff47bfc27eb1" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-976dff2d-74eb-4a50-8772-ff47bfc27eb1" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:14 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7136b77-8e57-4cc7-8dac-e02096594545]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24" returned: 0 in 0.412s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:14 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 Jul 20 16:49:14 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade" returned: 0 in 0.476s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf8d62-8feb-4052-bc81-1fabd33e8a29]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 Jul 20 16:49:14 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.367s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Deleted volume successfully. Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-91d419fe-35a0-4ec1-9a47-81c368408a69 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-7124b1bb-d0f0-4539-9d68-034ac72e186e-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:14 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 Jul 20 16:49:14 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24" returned: 0 in 0.304s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:14 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info Jul 20 16:49:14 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:14 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1" returned: 0 in 0.430s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1 Jul 20 16:49:15 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade Jul 20 16:49:15 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info Jul 20 16:49:15 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-976dff2d-74eb-4a50-8772-ff47bfc27eb1" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-976dff2d-74eb-4a50-8772-ff47bfc27eb1" released by "delete_volume" :: held 0.768s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created reservations ['d6462b4b-0d4e-4ada-85df-d7860e2176c4', '04405e88-7859-49a3-b75d-aa1bdc9bab0a', '574b9cef-7143-4962-bda4-fdaf428587e2', 'dd1d60be-209a-4211-8d46-408bd4ddae96'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:15 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.info" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade Jul 20 16:49:15 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.303s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Creating offline snapshot 0bf97157-71ff-4a21-a6d5-e44712ab5d6d of volume fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aaf7cc-0223-4883-99a3-76ee65ae7f41]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f091efd4-5748-4dab-aebb-b949c64fbb35 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 918d83a7-8220-4eec-9693-3390701734b5: created successfully Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-quobyte-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:15 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:15 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2a3b5e-3258-4c80-98d1-01d30fabcd7a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:15 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Deleted volume successfully. Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe88866a-d095-4d26-a9c3-0464d2089eef tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-976dff2d-74eb-4a50-8772-ff47bfc27eb1-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:15 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7.fb90e3ce-090f-46a8-b289-912412c92ade" returned: 0 in 0.368s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-quobyte-fb90e3ce-090f-46a8-b289-912412c92ade" released by "_delete_snapshot" :: held 1.806s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-quobyte-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" released by "delete_snapshot" :: held 1.858s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:15 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f Jul 20 16:49:15 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Created reservations ['3f2a6a16-c03b-4054-877a-f7e5c32c829f', '9a00e039-45ef-457d-bb9f-139bdab29780', '765a3987-c547-4213-b4ea-e6923da90390', 'e7e7d758-d3f7-494b-88e7-d83b4e7470e7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Delete snapshot completed successfully. Jul 20 16:49:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-951119dd-71a7-4f81-96cb-03973b96dc0d tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-fb90e3ce-090f-46a8-b289-912412c92ade-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:16 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.479s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:16 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d 1G Jul 20 16:49:16 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:16 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f" returned: 0 in 0.440s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "cinder-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:16 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f Jul 20 16:49:16 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "cinder-quobyte-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-quobyte-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ce6902-19ee-4d2d-b655-e9b72f107729]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:16 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 Jul 20 16:49:16 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:16 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f" returned: 0 in 0.320s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:16 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f" released by "delete_volume" :: held 0.816s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d 1G" returned: 0 in 0.523s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:16 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:16 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created reservations ['ff03ee24-55b6-42a4-a22e-3f4c6b5e4c90', 'cdd72726-8b4e-48dd-9242-6a5736b9a10b', '3da685fe-873d-49cb-9242-e0d8fcbe06fc', '699d1379-a066-49c4-af6e-c59b66ad3f26'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:16 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:16 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-04755e48-deec-4281-9be9-464d34ed0628-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:16 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" returned: 0 in 0.510s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-04755e48-deec-4281-9be9-464d34ed0628-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:16 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7 Jul 20 16:49:16 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:16 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.426s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:16 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d is being set with open permissions: ugo+rw Jul 20 16:49:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "cinder-quobyte-04755e48-deec-4281-9be9-464d34ed0628" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:17 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:17 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-04755e48-deec-4281-9be9-464d34ed0628" acquired by "delete_volume" :: waited 0.048s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[755325b3-ac89-4a60-8425-3fecc28939a9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:17 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Deleted volume successfully. Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e843c12-23e6-489d-80b7-f15792b098b1 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-7dd18f1f-2bd1-455f-8cb4-8b57b4d65f6f-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:17 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 Jul 20 16:49:17 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:17 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" returned: 0 in 0.370s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-quobyte-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7" released by "delete_volume" :: held 0.952s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:17 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.344s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Created reservations ['c8e75fb4-6046-40f5-b805-d9eee19e2f9b', '258457fd-0add-44b3-9615-ae0a7d8a7997', '5ade18f1-7be1-43e6-81a5-416e258b1f97', '98ec6955-bfa5-4ddd-a3fc-30637a9f6171'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:17 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info Jul 20 16:49:17 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:17 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:17 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:17 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628" returned: 0 in 0.515s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:17 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628 Jul 20 16:49:17 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:17 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info" returned: 0 in 0.307s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info is being set with open permissions: ugo+rw Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:17 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info Jul 20 16:49:17 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:17 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Deleted volume successfully. Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0cf79f0-65d6-47c7-86e1-cf45af0d1505 tempest-SnapshotMetadataTestJSON-2126176047 None] Lock "cinder-9ed2f7ce-eb9c-4449-a72f-f145ef5823a7-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:17 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-04755e48-deec-4281-9be9-464d34ed0628" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-quobyte-04755e48-deec-4281-9be9-464d34ed0628" released by "delete_volume" :: held 0.840s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Created reservations ['41ef95f8-c660-45a9-bbf4-aba517a46112', 'ef429d2a-086b-4af0-9d29-1cdb54a00bc6', 'b60a22c9-6b37-43f8-a8e8-85203705c2df', '781e7ca8-4625-4ec3-84ec-dbfd3ed14bf6'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:17 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.info" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.816s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-db39f379-1b21-423d-8f54-88982a1d8a24-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-db39f379-1b21-423d-8f54-88982a1d8a24-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Creating volume f176e5ac-6093-46fe-a87a-3a37f4b52ff0 from snapshot db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c787baef-28cd-46b5-9f7c-3e152e3690ea tempest-VolumesDeleteCascade-1358072704 None] Create snapshot completed successfully Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] snapshot: db39f379-1b21-423d-8f54-88982a1d8a24, volume: f176e5ac-6093-46fe-a87a-3a37f4b52ff0, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:18 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:18 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22c48d-2b25-4c73-9b7d-c31b2cb58a50]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:18 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 Jul 20 16:49:18 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:18 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Deleted volume successfully. Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0b7b4fff-36fb-4a32-bf75-26b2fe4c7958 tempest-CreateVolumesFromSourceVolumeTest-1219092701 None] Lock "cinder-04755e48-deec-4281-9be9-464d34ed0628-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:18 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24" returned: 0 in 0.439s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a2c52af-fe64-4291-9d5c-014bb836ca71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[54738451-93dd-4c6f-9d2a-7b1b8e325f79]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:18 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:18 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:19 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.488s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:19 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:49:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:19 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 Jul 20 16:49:19 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:24 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" returned: 0 in 5.518s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9726a-d55d-4378-8cdd-309bead9e2c9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:24 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:24 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:25 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.611s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:49:25 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Converted 1024.00 MB image at 185.49 MB/s Jul 20 16:49:25 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:25 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 Jul 20 16:49:25 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:25 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" returned: 0 in 0.314s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" released by "_copy_volume_from_snapshot" :: held 7.538s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-db39f379-1b21-423d-8f54-88982a1d8a24-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" released by "_create_volume_from_snapshot" :: held 7.581s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.606s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.935s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Creating offline snapshot fabcf430-0c6d-447c-8074-6e9270bce4a7 of volume fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2dc289-01f1-4808-a24e-3ee128edbd2e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-95b21c68-86f7-4f01-9e0f-3051763b38d2 tempest-GroupSnapshotsTest-835633462 None] Create group from source-snapshot-918d83a7-8220-4eec-9693-3390701734b5 completed successfully. Jul 20 16:49:25 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:25 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:26 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.408s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee900f1-db8b-40ca-8c76-09b681cd7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:26 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 1G Jul 20 16:49:26 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:26 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 1G" returned: 0 in 0.546s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:26 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 Jul 20 16:49:26 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:27 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7" returned: 0 in 0.353s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:27 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 is being set with open permissions: ugo+rw Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:27 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 Jul 20 16:49:27 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:27 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7" returned: 0 in 0.375s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" acquired by "delete_volume" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b607d42b-5f9d-422d-aaae-132a00d16806 tempest-VolumesDeleteCascade-1358072704 None] Create snapshot completed successfully Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cfd58c-57cf-4c74-aec2-5575f9b0f993]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Flow 'volume_create_manager' (2cbbeb5e-1d9b-488e-bec9-451ef1fd2b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf2d15-012b-4645-a8c0-a3537ae47699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdf2d15-012b-4645-a8c0-a3537ae47699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1499630903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e0557c-346f-4ec2-8ee0-fb060e2907c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace697638c1a4205abaafc44e8157926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:27Z,use_quota=True,user_id='069aab7f9fad4490bfda3d05801c8c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8aa80f-926d-460b-a230-fdfe71a20bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8aa80f-926d-460b-a230-fdfe71a20bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ae0479-d78c-4839-b2de-8aa9817e41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ae0479-d78c-4839-b2de-8aa9817e41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e0557c-346f-4ec2-8ee0-fb060e2907c2', 'volume_name': 'volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:27 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 Jul 20 16:49:27 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca1ed90-82f8-4377-8baa-846bb733f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca1ed90-82f8-4377-8baa-846bb733f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1a6a5c-2dca-47c0-95d4-d80fcf13bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:27 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Volume a3e0557c-346f-4ec2-8ee0-fb060e2907c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2', 'volume_size': 1} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1499630903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e0557c-346f-4ec2-8ee0-fb060e2907c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace697638c1a4205abaafc44e8157926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:27Z,use_quota=True,user_id='069aab7f9fad4490bfda3d05801c8c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Creating volume a3e0557c-346f-4ec2-8ee0-fb060e2907c2 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:27 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:27 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 1073741824 Jul 20 16:49:27 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:27 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" returned: 0 in 0.385s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:27 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0 Jul 20 16:49:27 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:28 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 1073741824" returned: 0 in 0.502s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:28 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-f176e5ac-6093-46fe-a87a-3a37f4b52ff0" released by "delete_volume" :: held 0.723s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:28 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 Jul 20 16:49:28 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['a6d87cec-3a06-4e7b-871c-ffe7d9940a44'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:28 devstack cinder-volume[87535]: WARNING cinder.quota [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-973532031 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-973532031, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:49:28 devstack cinder-volume[87535]: WARNING cinder.quota [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-973532031 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-973532031, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['298a145e-376e-418c-a169-d8c9f2758055', '1a6b7222-0b61-458f-bded-a1b1e3635f1f', 'd12cf1fd-d141-40bb-b6ac-25de094ea997', '47c8fa91-9c62-48dc-baaa-deea601c5733'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:28 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:28 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:28 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2" returned: 0 in 0.305s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1a6a5c-2dca-47c0-95d4-d80fcf13bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec01d22b-1175-48e0-9211-ec87669e8cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Volume volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 (a3e0557c-346f-4ec2-8ee0-fb060e2907c2): created successfully Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec01d22b-1175-48e0-9211-ec87669e8cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Flow 'volume_create_manager' (2cbbeb5e-1d9b-488e-bec9-451ef1fd2b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bb4d3aa4-69a0-4433-bf43-cbb2fb62c7ac tempest-VolumesNegativeTest-729440715 None] Created volume successfully. Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-fee900f1-db8b-40ca-8c76-09b681cd7baf-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-fee900f1-db8b-40ca-8c76-09b681cd7baf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Performing cascade delete. {{(pid=87535) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-0bf97157-71ff-4a21-a6d5-e44712ab5d6d-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-0bf97157-71ff-4a21-a6d5-e44712ab5d6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-0bf97157-71ff-4a21-a6d5-e44712ab5d6d" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-0bf97157-71ff-4a21-a6d5-e44712ab5d6d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Deleting offline snapshot 0bf97157-71ff-4a21-a6d5-e44712ab5d6d of volume fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:28 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] snapshot_file for this snap is: volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 918d83a7-8220-4eec-9693-3390701734b5: deleting Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-dc7debcb-ce85-44fd-95a1-236ab5bedb10 tempest-GroupSnapshotsTest-835633462 None] Delete group completed successfully. Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f2ea3-b92a-403e-914f-92b249692980]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 918d83a7-8220-4eec-9693-3390701734b5: deleting {{(pid=87535) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-6a2c52af-fe64-4291-9d5c-014bb836ca71" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-6a2c52af-fe64-4291-9d5c-014bb836ca71" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-db39f379-1b21-423d-8f54-88982a1d8a24" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-db39f379-1b21-423d-8f54-88982a1d8a24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Deleting offline snapshot db39f379-1b21-423d-8f54-88982a1d8a24 of volume 6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] snapshot_file for this snap is: volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4770229-468d-449b-be39-0a57279dc73f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:29 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:29 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:29 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 Jul 20 16:49:29 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:29 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.410s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee900f1-db8b-40ca-8c76-09b681cd7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6732a34-ed53-4e50-bb91-bcbfb05fd4b8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:29 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24" returned: 0 in 0.425s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a2c52af-fe64-4291-9d5c-014bb836ca71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:29 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:29 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c8c78-148a-43d9-b0b9-c40b6b1e434d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:29 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:29 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:29 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.491s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec1369d-cf5a-48d6-94fa-daa82f6e76a2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:29 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.501s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:29 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 Jul 20 16:49:29 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:30 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 Jul 20 16:49:30 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:30 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7" returned: 0 in 0.515s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee900f1-db8b-40ca-8c76-09b681cd7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce48c75-cfad-4ab1-bc04-7c72e62124ff]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:30 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24" returned: 0 in 0.522s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:30 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24 Jul 20 16:49:30 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:30 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:30 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:30 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71.db39f379-1b21-423d-8f54-88982a1d8a24" returned: 0 in 0.362s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-db39f379-1b21-423d-8f54-88982a1d8a24" released by "_delete_snapshot" :: held 1.947s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-6a2c52af-fe64-4291-9d5c-014bb836ca71" released by "delete_snapshot" :: held 1.977s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:30 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:31 devstack cinder-volume[87535]: WARNING cinder.quota [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-973532031 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-973532031, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.598s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee900f1-db8b-40ca-8c76-09b681cd7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f6a3c-9724-44fa-8f72-3168e8df2ae9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['986002c3-6d7b-4f09-9a8e-1c33c089a0a7', 'efbeac14-5979-4465-b813-5a71daed823a', '723c38d1-d035-4935-8634-0790779835b5', 'd3e56d38-5672-49e4-8ed7-e793eadb089b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ba3041d4-8bb9-4bbe-b5f4-1d949a0ac7e7 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 918d83a7-8220-4eec-9693-3390701734b5: deleted successfully Jul 20 16:49:31 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:31 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:31 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.461s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:31 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:31 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-6a2c52af-fe64-4291-9d5c-014bb836ca71" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-6a2c52af-fe64-4291-9d5c-014bb836ca71" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851cc43-db33-49a2-ac47-6700bc9c909b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:31 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:31 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:31 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.491s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:32 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d Jul 20 16:49:32 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:32 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.540s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:32 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71 Jul 20 16:49:32 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:32 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.0bf97157-71ff-4a21-a6d5-e44712ab5d6d" returned: 0 in 0.408s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 -F qcow2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:32 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 -F qcow2 Jul 20 16:49:32 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:32 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-6a2c52af-fe64-4291-9d5c-014bb836ca71" returned: 0 in 0.418s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-6a2c52af-fe64-4291-9d5c-014bb836ca71" released by "delete_volume" :: held 1.081s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['b0fba1d7-3564-4da8-bc4a-2eb25a4e70b5'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:32 devstack cinder-volume[87535]: WARNING cinder.db.api [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-973532031'] Jul 20 16:49:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['68ed948d-50ce-4469-a0c0-a338d10f0eda', '6d28b3ac-e946-469e-a73d-40dd9e0959c0', 'de873422-03d5-4f9b-9d05-055a615a5ab9', '56056a5c-120e-400a-8854-2bb24bf71cea'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:33 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fee900f1-db8b-40ca-8c76-09b681cd7baf /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 -F qcow2" returned: 0 in 0.615s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-0bf97157-71ff-4a21-a6d5-e44712ab5d6d" released by "_delete_snapshot" :: held 4.278s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" released by "delete_snapshot" :: held 4.320s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Created reservations ['6f7b4b38-d63b-47cc-bc78-49f3bd843f7b', '0063e5a6-c51d-4759-8142-3ee25cee7a31', '72c3e459-ece1-4275-a693-8ba66d9cd6e7', 'e76c2e78-bc81-46e3-b344-4f56fa0c0dc4'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:33 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:33 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Delete snapshot completed successfully. Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-0bf97157-71ff-4a21-a6d5-e44712ab5d6d-delete_snapshot" released by "delete_snapshot" :: held 4.555s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-fabcf430-0c6d-447c-8074-6e9270bce4a7-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-fabcf430-0c6d-447c-8074-6e9270bce4a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-fabcf430-0c6d-447c-8074-6e9270bce4a7" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fabcf430-0c6d-447c-8074-6e9270bce4a7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Deleting offline snapshot fabcf430-0c6d-447c-8074-6e9270bce4a7 of volume fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] snapshot_file for this snap is: volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[44190010-a101-4aaa-a698-bf27b4a4da90]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:33 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:33 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 Jul 20 16:49:33 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.391s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-dde61f36-9425-457a-bb84-45028462cc88 tempest-GroupSnapshotsTest-835633462 None] Delete group completed successfully. Jul 20 16:49:33 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7" returned: 0 in 0.454s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fee900f1-db8b-40ca-8c76-09b681cd7baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b488b38-edd0-4f0f-9204-c466cdfb47ae]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:34 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:34 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:34 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.450s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:34 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 Jul 20 16:49:34 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5a1ec24f-cb77-4c48-b1a0-5c5a0206a89f tempest-GroupSnapshotsTest-835633462 None] Group tempest-GroupSnapshotsTest-Group-205372999: creating Jul 20 16:49:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5a1ec24f-cb77-4c48-b1a0-5c5a0206a89f tempest-GroupSnapshotsTest-835633462 None] Group tempest-GroupSnapshotsTest-Group-205372999: created successfully Jul 20 16:49:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5a1ec24f-cb77-4c48-b1a0-5c5a0206a89f tempest-GroupSnapshotsTest-835633462 None] Create group completed successfully. Jul 20 16:49:34 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7" returned: 0 in 0.487s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:34 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7 Jul 20 16:49:34 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:35 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf.fabcf430-0c6d-447c-8074-6e9270bce4a7" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fabcf430-0c6d-447c-8074-6e9270bce4a7" released by "_delete_snapshot" :: held 1.799s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" released by "delete_snapshot" :: held 1.847s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Created reservations ['25f93de6-d4d4-4c69-9e3e-c9627cad28c5', '7741986c-35a2-4684-a8c3-a37c5c26bab4', '4f2aab79-4a9f-4d19-b0b6-0613dff076ec', '239dac98-6a67-49fe-92dd-aadd2ca72008'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Delete snapshot completed successfully. Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-fabcf430-0c6d-447c-8074-6e9270bce4a7-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Snapshots deleted, issuing volume delete {{(pid=87535) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e56a89-0fa7-43db-ac63-c0fdcfe5950f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:35 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:35 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:35 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.496s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:36 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf Jul 20 16:49:36 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:36 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fee900f1-db8b-40ca-8c76-09b681cd7baf" returned: 0 in 0.464s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-fee900f1-db8b-40ca-8c76-09b681cd7baf" released by "delete_volume" :: held 1.090s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Created reservations ['58952c13-99fb-45ee-aca6-6f7056784fa2', '826b1ab6-684c-4e6c-9d4a-89686e24ca50', '0b5454d9-3e00-42e3-bd92-d0653d6893d6', '0ad53588-7bed-45cc-94ec-4732e58d7bf3'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:36 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:36 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:37 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (72283a4a-5dcf-4780-b062-52b34942bc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5701ed1c-f626-498b-a28a-a2b0cc03ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.497s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:37 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Deleted volume successfully. Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5701ed1c-f626-498b-a28a-a2b0cc03ceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1028029415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11212eaa-0632-4cfb-a0b7-dc1a01e3fe6f,host='devstack@QuobyteHD#QuobyteHD',id=9e0464ba-c59e-47d4-8a31-a6dfabbccc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:37Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d519660-ab0f-4d2b-bfaf-a27e685ec7c0),volume_type_id=2d519660-ab0f-4d2b-bfaf-a27e685ec7c0)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6173257f-0f82-4d94-9900-d8ee7727bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6173257f-0f82-4d94-9900-d8ee7727bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04320c4-53da-4893-9960-5a1f35e24759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04320c4-53da-4893-9960-5a1f35e24759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0464ba-c59e-47d4-8a31-a6dfabbccc34', 'volume_name': 'volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935f66e7-d865-4a25-9a15-7ea93ad5e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935f66e7-d865-4a25-9a15-7ea93ad5e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ea8ca2-82c3-4371-ba30-646a6b476c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:37 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Volume 9e0464ba-c59e-47d4-8a31-a6dfabbccc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34', 'volume_size': 1} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11212eaa-0632-4cfb-a0b7-dc1a01e3fe6f,created_at=2026-07-20T14:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1028029415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11212eaa-0632-4cfb-a0b7-dc1a01e3fe6f,host='devstack@QuobyteHD#QuobyteHD',id=9e0464ba-c59e-47d4-8a31-a6dfabbccc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:37Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d519660-ab0f-4d2b-bfaf-a27e685ec7c0),volume_type_id=2d519660-ab0f-4d2b-bfaf-a27e685ec7c0)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Creating volume 9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:37 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-72a9cb4a-f908-4c8d-a9dc-9d6fe7f67070 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-fee900f1-db8b-40ca-8c76-09b681cd7baf-delete_volume" released by "delete_volume" :: held 8.909s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:37 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 1073741824 Jul 20 16:49:37 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:38 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 1073741824" returned: 0 in 0.933s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:38 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 Jul 20 16:49:38 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Flow 'volume_create_manager' (40dc3030-a235-4111-9e15-7ae4a92d087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d9232c-af8d-405c-9d01-12fae7f07168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d9232c-af8d-405c-9d01-12fae7f07168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1927221558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77eec3a-2cbe-4c28-bd10-f57966af6e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0908f753d849bca3952191f9fc4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:39Z,use_quota=True,user_id='577aafccdffb4cb8b22ea659d02752c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064d79f2-e7da-4ffe-88fb-1eabf9f91601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064d79f2-e7da-4ffe-88fb-1eabf9f91601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914dd19f-2be8-4258-819f-c3a8263b98ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914dd19f-2be8-4258-819f-c3a8263b98ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77eec3a-2cbe-4c28-bd10-f57966af6e5e', 'volume_name': 'volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cbae27-3fe6-4da6-8446-a30dfb0b6bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cbae27-3fe6-4da6-8446-a30dfb0b6bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e471d4a1-bca0-465c-b56d-34df742ee090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:38 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Volume b77eec3a-2cbe-4c28-bd10-f57966af6e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e', 'volume_size': 1} Jul 20 16:49:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:39 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" returned: 0 in 0.532s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1927221558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77eec3a-2cbe-4c28-bd10-f57966af6e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0908f753d849bca3952191f9fc4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:39Z,use_quota=True,user_id='577aafccdffb4cb8b22ea659d02752c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Creating volume b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:39 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:39 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e 1073741824 Jul 20 16:49:39 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ea8ca2-82c3-4371-ba30-646a6b476c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514bf141-5bc8-4906-83eb-a5f2d787e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:39 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Volume volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 (9e0464ba-c59e-47d4-8a31-a6dfabbccc34): created successfully Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514bf141-5bc8-4906-83eb-a5f2d787e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (72283a4a-5dcf-4780-b062-52b34942bc5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-014adea1-f63c-4174-812a-42db50833f62 tempest-GroupSnapshotsTest-835633462 None] Created volume successfully. Jul 20 16:49:39 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:39 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:39 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:49:39 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e 1073741824" returned: 0 in 0.803s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:39 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:39 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:40 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.475s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e471d4a1-bca0-465c-b56d-34df742ee090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339a7721-a41d-459f-b7dc-9342d550d733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:40 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Volume volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e (b77eec3a-2cbe-4c28-bd10-f57966af6e5e): created successfully Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339a7721-a41d-459f-b7dc-9342d550d733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Flow 'volume_create_manager' (40dc3030-a235-4111-9e15-7ae4a92d087b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-706e4ed2-2099-437c-b29d-0885c7daf272 tempest-VolumesDeleteCascade-1358072704 None] Created volume successfully. Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (1db077ed-97e9-4599-8200-cb12aeb096b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906d8848-6995-431f-8163-177e7b4e0021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906d8848-6995-431f-8163-177e7b4e0021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560609752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11212eaa-0632-4cfb-a0b7-dc1a01e3fe6f,host='devstack@QuobyteHD#QuobyteHD',id=e386fe72-0a1d-4dfd-907c-13bb2a45258f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:41Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d519660-ab0f-4d2b-bfaf-a27e685ec7c0),volume_type_id=2d519660-ab0f-4d2b-bfaf-a27e685ec7c0)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c288ef5-aa00-48fa-af0b-5d8fdd4db67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c288ef5-aa00-48fa-af0b-5d8fdd4db67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd563d7-d473-4ce1-a31c-259dfd37a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd563d7-d473-4ce1-a31c-259dfd37a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e386fe72-0a1d-4dfd-907c-13bb2a45258f', 'volume_name': 'volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39394478-c976-487a-bf95-27efaea62423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39394478-c976-487a-bf95-27efaea62423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401a7d23-26fe-4c5d-8769-707f895ea020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:40 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Volume e386fe72-0a1d-4dfd-907c-13bb2a45258f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f', 'volume_size': 1} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11212eaa-0632-4cfb-a0b7-dc1a01e3fe6f,created_at=2026-07-20T14:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560609752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11212eaa-0632-4cfb-a0b7-dc1a01e3fe6f,host='devstack@QuobyteHD#QuobyteHD',id=e386fe72-0a1d-4dfd-907c-13bb2a45258f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:41Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d519660-ab0f-4d2b-bfaf-a27e685ec7c0),volume_type_id=2d519660-ab0f-4d2b-bfaf-a27e685ec7c0)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Creating volume e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:40 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:49:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:41 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f 1073741824 Jul 20 16:49:41 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:41 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f 1073741824" returned: 0 in 0.652s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:41 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f Jul 20 16:49:41 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:41 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.783s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401a7d23-26fe-4c5d-8769-707f895ea020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9b5cf7-c826-4fdc-94dd-0073d0df8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Creating offline snapshot 59769129-f9cf-4cc9-8d0d-cc05c4d24f75 of volume b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:42 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Volume volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f (e386fe72-0a1d-4dfd-907c-13bb2a45258f): created successfully Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a9b5cf7-c826-4fdc-94dd-0073d0df8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (1db077ed-97e9-4599-8200-cb12aeb096b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2087772d-5273-438d-8057-dd480e9c3a2e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-66db7efd-707e-4d3e-832d-20d7bcd20fc3 tempest-GroupSnapshotsTest-835633462 None] Created volume successfully. Jul 20 16:49:42 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:42 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3984eb61-84ba-4eae-b0a9-8531ae4ae983 tempest-GroupSnapshotsTest-835633462 None] Update group completed successfully. Jul 20 16:49:42 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.416s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:42 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 1G Jul 20 16:49:42 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:42 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 1G" returned: 0 in 0.419s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:42 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 Jul 20 16:49:42 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:43 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75" returned: 0 in 0.309s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:43 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 is being set with open permissions: ugo+rw Jul 20 16:49:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:43 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 Jul 20 16:49:43 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:43 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75" returned: 0 in 0.338s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:43 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-076a8760-9e75-41e7-8b5f-95c0a3c0d900 tempest-GroupSnapshotsTest-835633462 None] Update group completed successfully. Jul 20 16:49:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:43 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info Jul 20 16:49:43 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:43 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info" returned: 0 in 0.253s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:43 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info is being set with open permissions: ugo+rw Jul 20 16:49:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:43 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info Jul 20 16:49:43 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:44 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.info" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c80a9df1-b0ba-43df-a6d1-7f924af29064 tempest-VolumesDeleteCascade-1358072704 None] Create snapshot completed successfully Jul 20 16:49:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-37b2d0b3-ba26-42db-b25f-e72cdd53c0ba tempest-GroupSnapshotsTest-835633462 None] Update group completed successfully. Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Flow 'volume_create_manager' (6e6e9182-207a-4a54-b76e-9e98a860b5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4908ff1-0ce1-4295-92f3-ec1554c121c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4908ff1-0ce1-4295-92f3-ec1554c121c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2049761042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319d380d-d061-4e81-a926-9e4869cdeec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0908f753d849bca3952191f9fc4e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59769129-f9cf-4cc9-8d0d-cc05c4d24f75,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:49:45Z,use_quota=True,user_id='577aafccdffb4cb8b22ea659d02752c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f2d19-192a-4e2f-990c-64c941acd622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f2d19-192a-4e2f-990c-64c941acd622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5cc822-784f-47f2-997e-6412d1a8f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5cc822-784f-47f2-997e-6412d1a8f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '319d380d-d061-4e81-a926-9e4869cdeec5', 'volume_name': 'volume-319d380d-d061-4e81-a926-9e4869cdeec5', 'volume_size': 1, 'snapshot_id': '59769129-f9cf-4cc9-8d0d-cc05c4d24f75'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22de351f-e7ec-42ca-8356-c18a327479d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22de351f-e7ec-42ca-8356-c18a327479d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebce642-566c-49a7-95ea-6b901c1dfadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:45 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Volume 319d380d-d061-4e81-a926-9e4869cdeec5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-319d380d-d061-4e81-a926-9e4869cdeec5', 'volume_size': 1, 'snapshot_id': '59769129-f9cf-4cc9-8d0d-cc05c4d24f75'} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-59769129-f9cf-4cc9-8d0d-cc05c4d24f75-319d380d-d061-4e81-a926-9e4869cdeec5" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-59769129-f9cf-4cc9-8d0d-cc05c4d24f75-319d380d-d061-4e81-a926-9e4869cdeec5" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Creating volume 319d380d-d061-4e81-a926-9e4869cdeec5 from snapshot 59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-319d380d-d061-4e81-a926-9e4869cdeec5" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-319d380d-d061-4e81-a926-9e4869cdeec5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] snapshot: 59769129-f9cf-4cc9-8d0d-cc05c4d24f75, volume: 319d380d-d061-4e81-a926-9e4869cdeec5, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b69db9-c8c9-4d3c-885d-a14d1d6cb253]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:45 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 Jul 20 16:49:45 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:45 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75" returned: 0 in 0.409s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e724d-6b6f-439b-9211-fcf90413c3c7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:45 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:45 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:45 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.394s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:49:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d591d220-b316-4e56-b812-2bc5c53c3c8d tempest-GroupSnapshotsTest-835633462 None] Update group completed successfully. Jul 20 16:49:45 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 Jul 20 16:49:45 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] GroupSnapshot e4b589c5-2956-433e-a8b6-7cdb16b09ddb: creating. Jul 20 16:49:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Group snapshot e4b589c5-2956-433e-a8b6-7cdb16b09ddb: creating. {{(pid=87535) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 20 16:49:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:50 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5" returned: 0 in 4.930s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:50 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a977dc9-f955-4e3e-a459-703ddf605d84]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:50 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:50 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:51 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.574s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:49:51 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Converted 1024.00 MB image at 207.66 MB/s Jul 20 16:49:51 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 is being set with open permissions: ugo+rw Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:51 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 Jul 20 16:49:51 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Acquiring lock "cinder-a3e0557c-346f-4ec2-8ee0-fb060e2907c2-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Lock "cinder-a3e0557c-346f-4ec2-8ee0-fb060e2907c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Acquiring lock "cinder-quobyte-a3e0557c-346f-4ec2-8ee0-fb060e2907c2" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Lock "cinder-quobyte-a3e0557c-346f-4ec2-8ee0-fb060e2907c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d285a6-2c66-450e-8815-15c0996dd964]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:51 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5" returned: 0 in 0.271s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-319d380d-d061-4e81-a926-9e4869cdeec5" released by "_copy_volume_from_snapshot" :: held 6.676s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:51 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 Jul 20 16:49:51 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-59769129-f9cf-4cc9-8d0d-cc05c4d24f75-319d380d-d061-4e81-a926-9e4869cdeec5" released by "_create_volume_from_snapshot" :: held 6.707s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.730s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.474s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Creating offline snapshot 875bda54-02fb-44b1-be63-4ce083bf2b52 of volume 9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebce642-566c-49a7-95ea-6b901c1dfadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319d380d-d061-4e81-a926-9e4869cdeec5', 'volume_size': 1, 'snapshot_id': '59769129-f9cf-4cc9-8d0d-cc05c4d24f75'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c8b873-8afd-45f8-b36c-ad6c12da8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0a115f-3d82-4b66-8612-387c0f6cb566]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:51 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Volume volume-319d380d-d061-4e81-a926-9e4869cdeec5 (319d380d-d061-4e81-a926-9e4869cdeec5): created successfully Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c8b873-8afd-45f8-b36c-ad6c12da8543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:49:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Flow 'volume_create_manager' (6e6e9182-207a-4a54-b76e-9e98a860b5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:49:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-10578806-9bf5-45f6-b0a7-2a8fc9f192c2 tempest-VolumesDeleteCascade-1358072704 None] Created volume successfully. Jul 20 16:49:51 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 Jul 20 16:49:51 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:52 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:52 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2 Jul 20 16:49:52 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:52 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" returned: 0 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:52 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 1G Jul 20 16:49:52 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:52 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e0557c-346f-4ec2-8ee0-fb060e2907c2" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Lock "cinder-quobyte-a3e0557c-346f-4ec2-8ee0-fb060e2907c2" released by "delete_volume" :: held 0.682s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Created reservations ['543edfcd-dc86-46cb-85a4-6ce69347773c', 'abb82c12-6255-4b1c-aff2-58a2dfa8f6b0', '6adf92aa-4fc1-475e-a238-0c600ba8476d', '90a7fe4c-843d-4880-b644-c0be137e27e7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:52 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:52 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:52 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 1G" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:52 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 Jul 20 16:49:52 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:52 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Deleted volume successfully. Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-80511bd5-87ff-47f7-bd20-9d666bf0e0c2 tempest-VolumesNegativeTest-729440715 None] Lock "cinder-a3e0557c-346f-4ec2-8ee0-fb060e2907c2-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-b77eec3a-2cbe-4c28-bd10-f57966af6e5e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-b77eec3a-2cbe-4c28-bd10-f57966af6e5e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Performing cascade delete. {{(pid=87535) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-59769129-f9cf-4cc9-8d0d-cc05c4d24f75-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-59769129-f9cf-4cc9-8d0d-cc05c4d24f75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:52 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52" returned: 0 in 0.357s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:52 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-59769129-f9cf-4cc9-8d0d-cc05c4d24f75" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:52 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 Jul 20 16:49:52 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-59769129-f9cf-4cc9-8d0d-cc05c4d24f75" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Deleting offline snapshot 59769129-f9cf-4cc9-8d0d-cc05c4d24f75 of volume b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] snapshot_file for this snap is: volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c2f537-fc6f-4901-a565-3453d92ae340]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:53 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 Jul 20 16:49:53 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:53 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:53 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info Jul 20 16:49:53 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:53 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa16b6d8-6cca-4807-8301-083acf8cd0f4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:53 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:53 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:53 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:53 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:53 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info Jul 20 16:49:53 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:53 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.info" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Creating offline snapshot f3e9441a-78b2-4cf9-919c-0ecc7e7c849a of volume e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:49:53 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.442s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f171f2-025a-45d5-9419-ef1dc7ffcfd8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:53 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 Jul 20 16:49:53 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:53 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f Jul 20 16:49:53 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:54 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75" returned: 0 in 0.363s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:54 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75 Jul 20 16:49:54 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:54 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f" returned: 0 in 0.394s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:54 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a 1G Jul 20 16:49:54 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:54 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e.59769129-f9cf-4cc9-8d0d-cc05c4d24f75" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-59769129-f9cf-4cc9-8d0d-cc05c4d24f75" released by "_delete_snapshot" :: held 1.553s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" released by "delete_snapshot" :: held 1.582s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Created reservations ['26423c70-6bf0-4f1c-8c58-709a61afc814', '9041610c-dd7a-4a91-9a4c-63a253dda2d8', '45ed14ee-a5ba-4ba1-8a12-5dcd40354ef9', 'c1a5ff8a-321e-4f1d-9993-26ff4b81c8ad'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Delete snapshot completed successfully. Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-59769129-f9cf-4cc9-8d0d-cc05c4d24f75-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Snapshots deleted, issuing volume delete {{(pid=87535) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3735271-d444-4a29-81a2-00776c907e22]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:54 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a 1G" returned: 0 in 0.487s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:54 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a Jul 20 16:49:54 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:54 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:54 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:55 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" returned: 0 in 0.363s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:55 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:55 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a Jul 20 16:49:55 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:55 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.475s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:55 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e Jul 20 16:49:55 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:55 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:55 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info Jul 20 16:49:55 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:55 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-b77eec3a-2cbe-4c28-bd10-f57966af6e5e" released by "delete_volume" :: held 0.820s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Created reservations ['e760babd-fa7d-4645-942e-ca0e8c189140', '390197fa-f20b-4c27-a03b-ab0fe6169694', 'b48b2ba8-6143-44e7-812a-9cf4f974355e', '57ad04e9-2d3b-4bb3-adf2-798497ac1b66'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:55 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:55 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:55 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:55 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:55 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info Jul 20 16:49:55 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:55 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.253s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Deleted volume successfully. Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a61d1aba-6be8-4d94-b662-deb10d8403f8 tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-b77eec3a-2cbe-4c28-bd10-f57966af6e5e-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:55 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.info" returned: 0 in 0.261s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-951246f7-7d43-4f9d-bc01-6289a1a1eddd tempest-GroupSnapshotsTest-835633462 None] group_snapshot e4b589c5-2956-433e-a8b6-7cdb16b09ddb: created successfully Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-319d380d-d061-4e81-a926-9e4869cdeec5-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-319d380d-d061-4e81-a926-9e4869cdeec5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "cinder-quobyte-319d380d-d061-4e81-a926-9e4869cdeec5" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-319d380d-d061-4e81-a926-9e4869cdeec5" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe8bbf2-52ba-43c1-aca7-0aa4989f1c8f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:56 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 Jul 20 16:49:56 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:56 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5" returned: 0 in 0.397s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:56 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5 Jul 20 16:49:56 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] group_snapshot e4b589c5-2956-433e-a8b6-7cdb16b09ddb: deleting Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] group_snapshot e4b589c5-2956-433e-a8b6-7cdb16b09ddb: deleting {{(pid=87535) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-875bda54-02fb-44b1-be63-4ce083bf2b52" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-875bda54-02fb-44b1-be63-4ce083bf2b52" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Deleting offline snapshot 875bda54-02fb-44b1-be63-4ce083bf2b52 of volume 9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] snapshot_file for this snap is: volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b860aa-f385-4db7-a5d4-9d7016058789]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:57 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-319d380d-d061-4e81-a926-9e4869cdeec5" returned: 0 in 0.344s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-quobyte-319d380d-d061-4e81-a926-9e4869cdeec5" released by "delete_volume" :: held 0.793s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:57 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 Jul 20 16:49:57 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Created reservations ['a9e7c382-e2e5-412b-bec5-3aab72d047ea', '6eb5e397-666f-4128-8944-74a03aacfab3', 'b041034d-24af-438f-957f-35c1eb961ddd', 'e461f26c-d371-426d-bcdd-b3a062f2f37c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:57 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:49:57 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:57 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52" returned: 0 in 0.447s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab773300-0e30-4fd3-8e5e-6e6bf4da1f83]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:57 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.297s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:49:57 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Deleted volume successfully. Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76dc34d7-0b7c-4dc3-87f2-13ad732fc89f tempest-VolumesDeleteCascade-1358072704 None] Lock "cinder-319d380d-d061-4e81-a926-9e4869cdeec5-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:57 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 Jul 20 16:49:57 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:57 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:57 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 Jul 20 16:49:57 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:58 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52" returned: 0 in 0.474s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:58 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52 Jul 20 16:49:58 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:58 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34.875bda54-02fb-44b1-be63-4ce083bf2b52" returned: 0 in 0.299s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-875bda54-02fb-44b1-be63-4ce083bf2b52" released by "_delete_snapshot" :: held 1.759s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" released by "delete_snapshot" :: held 1.791s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-e386fe72-0a1d-4dfd-907c-13bb2a45258f" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-e386fe72-0a1d-4dfd-907c-13bb2a45258f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Deleting offline snapshot f3e9441a-78b2-4cf9-919c-0ecc7e7c849a of volume e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] snapshot_file for this snap is: volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb5a7dd-0d99-41c4-888d-1c53832e96cb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:58 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a Jul 20 16:49:58 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:59 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" returned: 0 in 0.401s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:49:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf159c6-7fd7-4fce-8d4f-2aa88b52a280]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:49:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:59 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f Jul 20 16:49:59 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:49:59 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 20 16:49:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f" returned: 0 in 0.470s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:49:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:49:59 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a Jul 20 16:49:59 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:00 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:00 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a Jul 20 16:50:00 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:00 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f.f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-f3e9441a-78b2-4cf9-919c-0ecc7e7c849a" released by "_delete_snapshot" :: held 1.701s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-e386fe72-0a1d-4dfd-907c-13bb2a45258f" released by "delete_snapshot" :: held 1.732s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:00 devstack cinder-volume[87535]: WARNING cinder.quota [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1372154238 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1372154238, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:50:00 devstack cinder-volume[87535]: WARNING cinder.quota [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1372154238 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1372154238, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Created reservations ['04b21d03-28e5-4bb1-96c7-3d747d57e129', 'f66ac4b7-1e02-4dae-aa4b-d8105a350dba', '68723602-caad-4129-b1f9-afb51fb0bae4', 'ab571840-9dfd-422f-864d-de64377746fc'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:00 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] Created reservations ['7c7af114-f9b9-4974-b10a-82b00cfde61f', '308a5b02-7a2e-403f-b9e2-1baa8b6f782a', '158a17ab-ddc6-4d97-a055-d982d2d27230', '858fc2c0-c737-472b-8928-b8c95845e30d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e5bbf12a-a06f-4eef-bb3a-76cb408377db tempest-GroupSnapshotsTest-835633462 None] group_snapshot e4b589c5-2956-433e-a8b6-7cdb16b09ddb: deleted successfully Jul 20 16:50:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e300d1b-129e-4600-998a-45b32ff84fd7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:02 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 Jul 20 16:50:02 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:02 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" returned: 0 in 0.499s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:02 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34 Jul 20 16:50:02 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Flow 'volume_create_manager' (2d580115-8bf4-4495-b885-187b4453ae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb44c819-ae42-403b-ab58-e3955ac2bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb44c819-ae42-403b-ab58-e3955ac2bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1970084655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8286fd91-69cd-4b0a-9598-6c70c82ee8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc9e88079814d8f9b2b86d323f44e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:02Z,use_quota=True,user_id='2ecb99db9f434d758f938c76e6ddd652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89951da-dc67-4bca-b116-ddbca795dd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89951da-dc67-4bca-b116-ddbca795dd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f95a3e-e65e-4ae8-9b3f-b92cced76817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f95a3e-e65e-4ae8-9b3f-b92cced76817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8286fd91-69cd-4b0a-9598-6c70c82ee8ef', 'volume_name': 'volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f268085-becf-4765-bdb2-8984f56aa51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f268085-becf-4765-bdb2-8984f56aa51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb991a8c-f4d2-4f11-ac04-5f28f8a9ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Volume 8286fd91-69cd-4b0a-9598-6c70c82ee8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef', 'volume_size': 1} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1970084655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8286fd91-69cd-4b0a-9598-6c70c82ee8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc9e88079814d8f9b2b86d323f44e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:02Z,use_quota=True,user_id='2ecb99db9f434d758f938c76e6ddd652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Creating volume 8286fd91-69cd-4b0a-9598-6c70c82ee8ef {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:02 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:02 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef 1073741824 Jul 20 16:50:02 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:02 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-9e0464ba-c59e-47d4-8a31-a6dfabbccc34" released by "delete_volume" :: held 0.864s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-e386fe72-0a1d-4dfd-907c-13bb2a45258f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-e386fe72-0a1d-4dfd-907c-13bb2a45258f" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcba08e-9b8d-4dfc-8a7d-83b703e8e27a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:02 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f Jul 20 16:50:02 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:03 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef 1073741824" returned: 0 in 0.523s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:03 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef Jul 20 16:50:03 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:03 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f" returned: 0 in 0.458s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:03 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f Jul 20 16:50:03 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:03 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb991a8c-f4d2-4f11-ac04-5f28f8a9ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba2ef03-744e-4a2e-adc4-27ebfe776b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:03 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Volume volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef (8286fd91-69cd-4b0a-9598-6c70c82ee8ef): created successfully Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba2ef03-744e-4a2e-adc4-27ebfe776b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Flow 'volume_create_manager' (2d580115-8bf4-4495-b885-187b4453ae4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a6922b69-4a3a-4c49-93b0-a8ee2baa909f tempest-VolumesTransfersV357Test-1425695152 None] Created volume successfully. Jul 20 16:50:03 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e386fe72-0a1d-4dfd-907c-13bb2a45258f" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-e386fe72-0a1d-4dfd-907c-13bb2a45258f" released by "delete_volume" :: held 0.868s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['3996c6a9-a67a-4367-952a-4dab10dedcd8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:03 devstack cinder-volume[87535]: WARNING cinder.quota [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1372154238 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1372154238, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['8ff346db-2398-4b93-9735-3418cdf079a2', 'fbf3ab79-4d6c-44b1-b09f-0232e821af66', '1691483b-7492-4a7f-b3fa-f8a0e0d45965', '6e203c38-94e4-4a7e-a2de-e3d8a386bd3b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['7a9f57a0-72dc-4e35-92f6-e3a5b41965b7', '10d42cea-e5e3-4b58-bb63-102ca6f9abe1', '2087b4e5-d007-42a8-9802-0b6b254cae26', '94028be7-f708-4a18-8e32-b4b18451de84'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:04 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:04 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:04 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.268s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:04 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f493fcf0-8e41-44de-86c4-14940f8473d0 tempest-GroupSnapshotsTest-835633462 None] Delete group completed successfully. Jul 20 16:50:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f33e0061-097d-4cdc-ace8-32d6ac624884 tempest-GroupSnapshotsTest-835633462 None] Group tempest-GroupSnapshotsTest-Group-2033576559: creating Jul 20 16:50:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f33e0061-097d-4cdc-ace8-32d6ac624884 tempest-GroupSnapshotsTest-835633462 None] Group tempest-GroupSnapshotsTest-Group-2033576559: created successfully Jul 20 16:50:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f33e0061-097d-4cdc-ace8-32d6ac624884 tempest-GroupSnapshotsTest-835633462 None] Create group completed successfully. Jul 20 16:50:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-73de63d4-7520-4e8d-9c2c-df281f877ae0 tempest-VolumesTransfersV357Test-1666870393 None] Transfer volume completed successfully. Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=245,cinder:SELECT=178,cinder:DELETE=15,cinder:INSERT=48 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:INSERT=61,cinder:UPDATE=204,cinder:SELECT=207,cinder:DELETE=13 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (eb9d2c18-40bd-4a94-aabd-c7d54e3ba28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1052bf39-5488-46ad-a268-7df0e1b77598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Acquiring lock "cinder-8286fd91-69cd-4b0a-9598-6c70c82ee8ef-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1052bf39-5488-46ad-a268-7df0e1b77598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1364479288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4772df-885e-4ba4-ad7f-70123c3023fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:06Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2654cc38-98ec-4cdb-bb0d-9ee266bfcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2654cc38-98ec-4cdb-bb0d-9ee266bfcb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7736ba0d-8e62-4cdb-823d-15082b835ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7736ba0d-8e62-4cdb-823d-15082b835ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4772df-885e-4ba4-ad7f-70123c3023fc', 'volume_name': 'volume-0d4772df-885e-4ba4-ad7f-70123c3023fc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2024d6-37cc-4abe-a860-81f93f9836e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2024d6-37cc-4abe-a860-81f93f9836e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59d6cd0-6e92-4c84-b5ff-0730baab6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Volume 0d4772df-885e-4ba4-ad7f-70123c3023fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4772df-885e-4ba4-ad7f-70123c3023fc', 'volume_size': 1} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1364479288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4772df-885e-4ba4-ad7f-70123c3023fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:06Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Creating volume 0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:05 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-8286fd91-69cd-4b0a-9598-6c70c82ee8ef-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:05 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc 1073741824 Jul 20 16:50:05 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Acquiring lock "cinder-quobyte-8286fd91-69cd-4b0a-9598-6c70c82ee8ef" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-quobyte-8286fd91-69cd-4b0a-9598-6c70c82ee8ef" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a00a45-e0a3-4a93-af23-6539d410b815]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:06 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef Jul 20 16:50:06 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:06 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:06 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc 1073741824" returned: 0 in 0.556s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef" returned: 0 in 0.471s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:06 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef Jul 20 16:50:06 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (190a5299-dece-4e2b-a5dd-976783d1bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a15fc5-fef2-4422-9ab0-b9b9a39498f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a15fc5-fef2-4422-9ab0-b9b9a39498f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-949679105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dddf7d5-12f2-4eb4-8a64-6dbb834684b1,host='devstack@QuobyteHD#QuobyteHD',id=3ad52866-4bf7-4165-a027-ece61a0a893b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:06Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a2f5819-2355-4065-9250-e224c5d99183),volume_type_id=7a2f5819-2355-4065-9250-e224c5d99183)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:06 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc Jul 20 16:50:06 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea03ec0a-1fe0-4c73-82bc-869fdde5bb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea03ec0a-1fe0-4c73-82bc-869fdde5bb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b553a3a-3492-47b6-a489-c572d49f7728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b553a3a-3492-47b6-a489-c572d49f7728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad52866-4bf7-4165-a027-ece61a0a893b', 'volume_name': 'volume-3ad52866-4bf7-4165-a027-ece61a0a893b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7100366a-e68d-49f1-a98e-d19f833720a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7100366a-e68d-49f1-a98e-d19f833720a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0286d1-a4fb-4679-ae0e-26b8ef020680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Volume 3ad52866-4bf7-4165-a027-ece61a0a893b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad52866-4bf7-4165-a027-ece61a0a893b', 'volume_size': 1} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:06 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8286fd91-69cd-4b0a-9598-6c70c82ee8ef" returned: 0 in 0.257s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-quobyte-8286fd91-69cd-4b0a-9598-6c70c82ee8ef" released by "delete_volume" :: held 0.772s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Created reservations ['98c6e560-2d43-4cdd-846f-7a2328b8707d', 'eae8519e-a16b-4144-922f-64e4bd710a4e', '8928d29f-229f-42e4-9d40-1b9c83e57174', '0e72fb53-bdc9-4aab-9108-4e10ad29246d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:06 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc" returned: 0 in 0.260s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3dddf7d5-12f2-4eb4-8a64-6dbb834684b1,created_at=2026-07-20T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-949679105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3dddf7d5-12f2-4eb4-8a64-6dbb834684b1,host='devstack@QuobyteHD#QuobyteHD',id=3ad52866-4bf7-4165-a027-ece61a0a893b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfe255d2b37644da8f972ac633dec507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:06Z,use_quota=True,user_id='caca90746f464300857b25aaf786b902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a2f5819-2355-4065-9250-e224c5d99183),volume_type_id=7a2f5819-2355-4065-9250-e224c5d99183)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Creating volume 3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:06 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59d6cd0-6e92-4c84-b5ff-0730baab6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4772df-885e-4ba4-ad7f-70123c3023fc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:06 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b 1073741824 Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d588f1a5-0d44-4445-bd15-53d3830b4df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:06 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Volume volume-0d4772df-885e-4ba4-ad7f-70123c3023fc (0d4772df-885e-4ba4-ad7f-70123c3023fc): created successfully Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d588f1a5-0d44-4445-bd15-53d3830b4df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (eb9d2c18-40bd-4a94-aabd-c7d54e3ba28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6351ecb4-a900-4fe5-96cd-7f679efd3e44 tempest-VolumesSnapshotTestJSON-503306434 None] Created volume successfully. Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:06 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:06 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:07 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.268s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Deleted volume successfully. Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-46465689-8b8c-4659-b6e0-172314cefe53 tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-8286fd91-69cd-4b0a-9598-6c70c82ee8ef-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:07 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b 1073741824" returned: 0 in 0.474s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:07 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b Jul 20 16:50:07 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Flow 'volume_create_manager' (bf1d2a2e-0466-452f-a112-9281467d493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dc925e-c600-4f28-a8cc-176991969a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56dc925e-c600-4f28-a8cc-176991969a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-490954775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196e208b-0c69-428c-bc2c-04d65a0aeed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc9e88079814d8f9b2b86d323f44e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:08Z,use_quota=True,user_id='2ecb99db9f434d758f938c76e6ddd652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:07 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a512fb-cfda-45b7-9d02-f66f05ffb57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a512fb-cfda-45b7-9d02-f66f05ffb57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6d6758-c96f-4e72-a758-a2eb736d6309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6d6758-c96f-4e72-a758-a2eb736d6309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196e208b-0c69-428c-bc2c-04d65a0aeed3', 'volume_name': 'volume-196e208b-0c69-428c-bc2c-04d65a0aeed3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64e2e11-67cd-4e61-9050-2ffcf538d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64e2e11-67cd-4e61-9050-2ffcf538d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f18c20-982f-4f57-a52a-93f9ff90b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Volume 196e208b-0c69-428c-bc2c-04d65a0aeed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196e208b-0c69-428c-bc2c-04d65a0aeed3', 'volume_size': 1} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b" returned: 0 in 0.285s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-490954775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196e208b-0c69-428c-bc2c-04d65a0aeed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc9e88079814d8f9b2b86d323f44e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:08Z,use_quota=True,user_id='2ecb99db9f434d758f938c76e6ddd652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Creating volume 196e208b-0c69-428c-bc2c-04d65a0aeed3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:07 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0286d1-a4fb-4679-ae0e-26b8ef020680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad52866-4bf7-4165-a027-ece61a0a893b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:07 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 1073741824 Jul 20 16:50:07 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c03039d-f229-4b23-a80c-6a977a83fc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Volume volume-3ad52866-4bf7-4165-a027-ece61a0a893b (3ad52866-4bf7-4165-a027-ece61a0a893b): created successfully Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c03039d-f229-4b23-a80c-6a977a83fc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Flow 'volume_create_manager' (190a5299-dece-4e2b-a5dd-976783d1bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2e3c4a93-68bd-47d7-b582-665850bd1ee1 tempest-GroupSnapshotsTest-835633462 None] Created volume successfully. Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:08 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 1073741824" returned: 0 in 0.487s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:08 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 Jul 20 16:50:08 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:08 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3" returned: 0 in 0.245s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.310s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f18c20-982f-4f57-a52a-93f9ff90b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196e208b-0c69-428c-bc2c-04d65a0aeed3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ed88e6-0575-41c2-b7ee-a66d097eb5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Creating offline snapshot 36fb48fe-2075-4770-bbee-d4d72f2853e2 of volume 0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:08 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Volume volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 (196e208b-0c69-428c-bc2c-04d65a0aeed3): created successfully Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ed88e6-0575-41c2-b7ee-a66d097eb5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Flow 'volume_create_manager' (bf1d2a2e-0466-452f-a112-9281467d493c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa94848-915f-4132-8417-6b88bcd64dcf]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9156d763-d924-4df8-a354-cd0c067fa45f tempest-VolumesTransfersV357Test-1425695152 None] Created volume successfully. Jul 20 16:50:08 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc Jul 20 16:50:08 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Acquiring lock "cinder-196e208b-0c69-428c-bc2c-04d65a0aeed3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:08 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-196e208b-0c69-428c-bc2c-04d65a0aeed3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc" returned: 0 in 0.411s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:08 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 1G Jul 20 16:50:08 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Acquiring lock "cinder-quobyte-196e208b-0c69-428c-bc2c-04d65a0aeed3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-quobyte-196e208b-0c69-428c-bc2c-04d65a0aeed3" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[290b6608-3383-4adc-9874-f0af5bff3abf]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] GroupSnapshot 2a624f7c-d39d-42ed-a3f5-bb4dd9e63118: creating. Jul 20 16:50:09 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 Jul 20 16:50:09 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Group snapshot 2a624f7c-d39d-42ed-a3f5-bb4dd9e63118: creating. {{(pid=87535) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:09 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 1G" returned: 0 in 0.431s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4772df-885e-4ba4-ad7f-70123c3023fc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:09 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4772df-885e-4ba4-ad7f-70123c3023fc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 Jul 20 16:50:09 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:09 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:09 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3 Jul 20 16:50:09 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:09 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4772df-885e-4ba4-ad7f-70123c3023fc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:09 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 is being set with open permissions: ugo+rw Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:09 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-196e208b-0c69-428c-bc2c-04d65a0aeed3" returned: 0 in 0.239s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:09 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-quobyte-196e208b-0c69-428c-bc2c-04d65a0aeed3" released by "delete_volume" :: held 0.672s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:09 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Created reservations ['7400c4ad-929b-4e79-8194-02e634ed0af7', 'd99a68db-5327-4623-938f-1b2b311855b0', 'e35fce31-ea42-45c9-a394-11c994f1bf5d', '2737fa11-3b57-4335-8308-3159078e5c58'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:09 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:09 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:09 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2" returned: 0 in 0.257s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:09 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info Jul 20 16:50:09 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:09 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:10 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Deleted volume successfully. Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-24cd806a-a33c-4f97-9b6b-477b8a1af7ad tempest-VolumesTransfersV357Test-911685947 None] Lock "cinder-196e208b-0c69-428c-bc2c-04d65a0aeed3-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:10 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:10 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info is being set with open permissions: ugo+rw Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:10 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info Jul 20 16:50:10 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:10 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.info" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.318s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Creating offline snapshot 0413b74e-6dac-4744-bf14-67490270c44a of volume 3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b87cdd3-49d3-4154-80a4-f2cee11cb2bd]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:10 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-62fd432e-3344-4467-9a48-0c67b6744ac3 tempest-VolumesSnapshotTestJSON-503306434 None] Create snapshot completed successfully Jul 20 16:50:10 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b Jul 20 16:50:10 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:10 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b" returned: 0 in 0.368s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:10 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a 1G Jul 20 16:50:10 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:11 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a 1G" returned: 0 in 0.468s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad52866-4bf7-4165-a027-ece61a0a893b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:11 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad52866-4bf7-4165-a027-ece61a0a893b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a Jul 20 16:50:11 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-36fb48fe-2075-4770-bbee-d4d72f2853e2-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-36fb48fe-2075-4770-bbee-d4d72f2853e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-0d4772df-885e-4ba4-ad7f-70123c3023fc" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-0d4772df-885e-4ba4-ad7f-70123c3023fc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-36fb48fe-2075-4770-bbee-d4d72f2853e2" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-36fb48fe-2075-4770-bbee-d4d72f2853e2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Deleting offline snapshot 36fb48fe-2075-4770-bbee-d4d72f2853e2 of volume 0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] snapshot_file for this snap is: volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb732eef-b303-420e-a2a6-e22d2f5c55b6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:11 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ad52866-4bf7-4165-a027-ece61a0a893b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a" returned: 0 in 0.414s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:50:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:11 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a Jul 20 16:50:11 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:11 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 Jul 20 16:50:11 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:11 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a" returned: 0 in 0.254s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:12 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info Jul 20 16:50:12 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:12 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2" returned: 0 in 0.438s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d4772df-885e-4ba4-ad7f-70123c3023fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7bc2fa-e945-4532-8147-fdf993e74626]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:12 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc Jul 20 16:50:12 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:12 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:12 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:12 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info Jul 20 16:50:12 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:12 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc" returned: 0 in 0.423s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:12 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 Jul 20 16:50:12 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:12 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.info" returned: 0 in 0.295s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8da40eb1-fe7b-4935-9457-1406ac77cd23 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 2a624f7c-d39d-42ed-a3f5-bb4dd9e63118: created successfully Jul 20 16:50:12 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2" returned: 0 in 0.418s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:13 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2 Jul 20 16:50:13 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:13 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc.36fb48fe-2075-4770-bbee-d4d72f2853e2" returned: 0 in 0.257s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-36fb48fe-2075-4770-bbee-d4d72f2853e2" released by "_delete_snapshot" :: held 1.677s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-0d4772df-885e-4ba4-ad7f-70123c3023fc" released by "delete_snapshot" :: held 1.701s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['234ad5f8-1757-4e74-9ac3-c6616a096c83', '562845d7-9526-41d6-bdbe-a56513ed1d0b', '7c965274-3555-460b-8c81-0247bf74ac35', '52545074-a3e9-4963-b2dc-115c9ac4c1bd'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Delete snapshot completed successfully. Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af6a3df2-e25a-4ddf-86b1-3b38c6c78450 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-36fb48fe-2075-4770-bbee-d4d72f2853e2-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 2a624f7c-d39d-42ed-a3f5-bb4dd9e63118: deleting Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 2a624f7c-d39d-42ed-a3f5-bb4dd9e63118: deleting {{(pid=87535) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-3ad52866-4bf7-4165-a027-ece61a0a893b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-3ad52866-4bf7-4165-a027-ece61a0a893b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-0413b74e-6dac-4744-bf14-67490270c44a" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-0413b74e-6dac-4744-bf14-67490270c44a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Deleting offline snapshot 0413b74e-6dac-4744-bf14-67490270c44a of volume 3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] snapshot_file for this snap is: volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ec62c-9f70-4828-8dec-287622ff6d2d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:13 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a Jul 20 16:50:13 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:14 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a" returned: 0 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ad52866-4bf7-4165-a027-ece61a0a893b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[15464bf9-f743-4b16-b58e-4212abe7a39a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:14 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b Jul 20 16:50:14 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (76f87eea-32ee-449b-8234-b0fdf3c1316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4b790-23bc-4372-a2f9-fbd671fbb9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:14 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b" returned: 0 in 0.464s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4b790-23bc-4372-a2f9-fbd671fbb9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-600188721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67abb256-8687-445d-bb82-9ebf7f1c0865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:14Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:14 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c926265d-cb8e-4b38-b337-f11bc8ec5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:14 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c926265d-cb8e-4b38-b337-f11bc8ec5c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a00e4-f446-4ec4-b2fc-0716e3999dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4a00e4-f446-4ec4-b2fc-0716e3999dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67abb256-8687-445d-bb82-9ebf7f1c0865', 'volume_name': 'volume-67abb256-8687-445d-bb82-9ebf7f1c0865', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe55672-934c-4394-9b55-5c6a3d5d0f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe55672-934c-4394-9b55-5c6a3d5d0f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933cbc7c-1114-40c5-b5d2-d2131766c40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Volume 67abb256-8687-445d-bb82-9ebf7f1c0865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67abb256-8687-445d-bb82-9ebf7f1c0865', 'volume_size': 1} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-600188721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67abb256-8687-445d-bb82-9ebf7f1c0865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:14Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Creating volume 67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:14 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:14 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 1073741824 Jul 20 16:50:14 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:14 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a" returned: 0 in 0.364s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:14 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a Jul 20 16:50:14 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:15 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 1073741824" returned: 0 in 0.516s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:15 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b.0413b74e-6dac-4744-bf14-67490270c44a" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:15 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:15 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-0413b74e-6dac-4744-bf14-67490270c44a" released by "_delete_snapshot" :: held 1.640s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-3ad52866-4bf7-4165-a027-ece61a0a893b" released by "delete_snapshot" :: held 1.678s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:15 devstack cinder-volume[87535]: WARNING cinder.quota [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1249511367 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1249511367, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:50:15 devstack cinder-volume[87535]: WARNING cinder.quota [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1249511367 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1249511367, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] Created reservations ['fbecc86f-ea92-4882-881a-d83ca570279b', 'f17fc689-0062-457a-991d-f5273e7f3403', '8112b2e6-fa38-41c5-9bfc-bbb34a4d3512', '2a104650-60bb-444b-8bc6-fda02a842b7b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0d5e48dc-3869-46da-bf79-9e72e975ae62 tempest-GroupSnapshotsTest-835633462 None] group_snapshot 2a624f7c-d39d-42ed-a3f5-bb4dd9e63118: deleted successfully Jul 20 16:50:15 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.296s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933cbc7c-1114-40c5-b5d2-d2131766c40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67abb256-8687-445d-bb82-9ebf7f1c0865', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a262901-c2a7-4c40-9579-21033ee33f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Volume volume-67abb256-8687-445d-bb82-9ebf7f1c0865 (67abb256-8687-445d-bb82-9ebf7f1c0865): created successfully Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a262901-c2a7-4c40-9579-21033ee33f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (76f87eea-32ee-449b-8234-b0fdf3c1316c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-92ac6a51-b81e-40cd-90c7-83c1a3c680fe tempest-VolumesSnapshotTestJSON-503306434 None] Created volume successfully. Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "cinder-quobyte-3ad52866-4bf7-4165-a027-ece61a0a893b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-3ad52866-4bf7-4165-a027-ece61a0a893b" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcdfb10-e80d-4dc6-8f1f-15bd68b16773]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:16 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b Jul 20 16:50:16 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:16 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b" returned: 0 in 0.424s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:16 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b Jul 20 16:50:16 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Creating offline snapshot adbc8c5d-3063-4588-9635-a32cf93b690d of volume 67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[867e24e8-ff0c-4071-a86f-4498ca040359]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:16 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:16 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:17 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3ad52866-4bf7-4165-a027-ece61a0a893b" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Lock "cinder-quobyte-3ad52866-4bf7-4165-a027-ece61a0a893b" released by "delete_volume" :: held 0.785s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Created reservations ['e03e79ac-5dea-463a-a362-314aec974ec7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:17 devstack cinder-volume[87535]: WARNING cinder.quota [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1249511367 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1249511367, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Created reservations ['55e95771-53ca-4403-901d-cc4db73badb4', '66c8ac4b-f86b-4130-be37-ae0425a05404', '47ec326e-e56d-4b70-9b89-6df030bfbc23', 'd71b3ba8-1def-4d9e-9c4a-285f3cefa406'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:17 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.420s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:17 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:17 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:17 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d 1G Jul 20 16:50:17 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:17 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9ed8eea5-7854-4e44-a456-17d9852e051e tempest-GroupSnapshotsTest-835633462 None] Delete group completed successfully. Jul 20 16:50:17 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d 1G" returned: 0 in 0.489s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67abb256-8687-445d-bb82-9ebf7f1c0865 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:17 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67abb256-8687-445d-bb82-9ebf7f1c0865 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d Jul 20 16:50:17 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:18 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67abb256-8687-445d-bb82-9ebf7f1c0865 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d" returned: 0 in 0.320s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:18 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d is being set with open permissions: ugo+rw Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:18 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d Jul 20 16:50:18 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:18 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:18 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info Jul 20 16:50:18 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:18 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:18 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info is being set with open permissions: ugo+rw Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:18 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info Jul 20 16:50:18 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:18 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.info" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e1f7b201-7863-4799-aa7c-e20939959208 tempest-VolumesSnapshotTestJSON-503306434 None] Create snapshot completed successfully Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (6325f7ca-6865-46e0-b6e3-c8f727d53a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0354f50a-6c39-4608-9e72-fbbd16dcb1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0354f50a-6c39-4608-9e72-fbbd16dcb1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-527385695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63be495-c96f-478a-9312-3aeb56b9e24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=adbc8c5d-3063-4588-9635-a32cf93b690d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:21Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfc2a1e-5546-47d7-b9ac-8724a457b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfc2a1e-5546-47d7-b9ac-8724a457b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475a32cd-4024-429a-bf36-41c2835e8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475a32cd-4024-429a-bf36-41c2835e8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b63be495-c96f-478a-9312-3aeb56b9e24a', 'volume_name': 'volume-b63be495-c96f-478a-9312-3aeb56b9e24a', 'volume_size': 2, 'snapshot_id': 'adbc8c5d-3063-4588-9635-a32cf93b690d'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0043f94-e2fc-49ff-9c46-0bfb5770be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0043f94-e2fc-49ff-9c46-0bfb5770be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6c3854-3de0-4f54-8c7f-d5ce4e2eb28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:20 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Volume b63be495-c96f-478a-9312-3aeb56b9e24a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b63be495-c96f-478a-9312-3aeb56b9e24a', 'volume_size': 2, 'snapshot_id': 'adbc8c5d-3063-4588-9635-a32cf93b690d'} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-adbc8c5d-3063-4588-9635-a32cf93b690d-b63be495-c96f-478a-9312-3aeb56b9e24a" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-adbc8c5d-3063-4588-9635-a32cf93b690d-b63be495-c96f-478a-9312-3aeb56b9e24a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Creating volume b63be495-c96f-478a-9312-3aeb56b9e24a from snapshot adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-b63be495-c96f-478a-9312-3aeb56b9e24a" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-b63be495-c96f-478a-9312-3aeb56b9e24a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] snapshot: adbc8c5d-3063-4588-9635-a32cf93b690d, volume: b63be495-c96f-478a-9312-3aeb56b9e24a, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396a48b-e9b5-40e3-a690-991b51bf7869]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:20 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d Jul 20 16:50:20 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:21 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d" returned: 0 in 0.413s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67abb256-8687-445d-bb82-9ebf7f1c0865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde8c9c-de16-427e-b0bb-4b36569a0925]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:21 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:21 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:21 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.406s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:50:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:21 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a Jul 20 16:50:21 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:27 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a" returned: 0 in 5.525s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4157f56a-d504-49f4-acec-a1620baa1732]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:27 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:27 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:27 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.599s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:27 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:50:27 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Converted 1024.00 MB image at 185.30 MB/s Jul 20 16:50:27 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a is being set with open permissions: ugo+rw Jul 20 16:50:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:27 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a Jul 20 16:50:27 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:28 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a" returned: 0 in 0.319s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-b63be495-c96f-478a-9312-3aeb56b9e24a" released by "_copy_volume_from_snapshot" :: held 7.381s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-adbc8c5d-3063-4588-9635-a32cf93b690d-b63be495-c96f-478a-9312-3aeb56b9e24a" released by "_create_volume_from_snapshot" :: held 7.418s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.435s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6c3854-3de0-4f54-8c7f-d5ce4e2eb28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63be495-c96f-478a-9312-3aeb56b9e24a', 'volume_size': 2, 'snapshot_id': 'adbc8c5d-3063-4588-9635-a32cf93b690d'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58711e76-55ac-426d-8a2f-e7d559f7c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Volume volume-b63be495-c96f-478a-9312-3aeb56b9e24a (b63be495-c96f-478a-9312-3aeb56b9e24a): created successfully Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58711e76-55ac-426d-8a2f-e7d559f7c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (6325f7ca-6865-46e0-b6e3-c8f727d53a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3e5d6fff-d451-469d-a162-788cc11e4f33 tempest-VolumesSnapshotTestJSON-503306434 None] Created volume successfully. Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-b63be495-c96f-478a-9312-3aeb56b9e24a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-b63be495-c96f-478a-9312-3aeb56b9e24a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-b63be495-c96f-478a-9312-3aeb56b9e24a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-b63be495-c96f-478a-9312-3aeb56b9e24a" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b26bec-e21b-4fc8-89b8-085e4f4fc5eb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:28 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a Jul 20 16:50:28 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:29 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a" returned: 0 in 0.427s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:29 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a Jul 20 16:50:29 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:29 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b63be495-c96f-478a-9312-3aeb56b9e24a" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-b63be495-c96f-478a-9312-3aeb56b9e24a" released by "delete_volume" :: held 0.770s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['e9a55a98-9cc4-4525-aab4-a4b8d1e439bc', 'db73a391-9070-4412-a6cf-ec11bbb6fe78', 'bc7b36e0-8c0c-497c-84b6-f2f09ebd3265', '0334b966-fc97-41f3-878b-28e0547756b6'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:29 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:29 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Flow 'volume_create_manager' (cf1db9ba-d7aa-4a63-a36b-abe47b126c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0786be4e-f6ae-46b2-a6d5-09708d65c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0786be4e-f6ae-46b2-a6d5-09708d65c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844396110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59548176-bb3d-4ef9-9a94-7e74520c40da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65104940e86c465691358ce211a84816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:30Z,use_quota=True,user_id='16ed9414c6a94d9894bfa06c670f3918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746800bf-1792-4e61-bf8e-13dc04d27f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746800bf-1792-4e61-bf8e-13dc04d27f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de06443-fe80-45e5-a0bb-1131264e226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de06443-fe80-45e5-a0bb-1131264e226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59548176-bb3d-4ef9-9a94-7e74520c40da', 'volume_name': 'volume-59548176-bb3d-4ef9-9a94-7e74520c40da', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c45e8cc-7c7b-49d4-96b2-721efa13cb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c45e8cc-7c7b-49d4-96b2-721efa13cb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd4bf04-2a9e-4d84-89cc-81b2c0ec1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Volume 59548176-bb3d-4ef9-9a94-7e74520c40da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59548176-bb3d-4ef9-9a94-7e74520c40da', 'volume_size': 1} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844396110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59548176-bb3d-4ef9-9a94-7e74520c40da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65104940e86c465691358ce211a84816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:30Z,use_quota=True,user_id='16ed9414c6a94d9894bfa06c670f3918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Creating volume 59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:29 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:29 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da 1073741824 Jul 20 16:50:29 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-adbc8c5d-3063-4588-9635-a32cf93b690d-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-adbc8c5d-3063-4588-9635-a32cf93b690d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-67abb256-8687-445d-bb82-9ebf7f1c0865" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-67abb256-8687-445d-bb82-9ebf7f1c0865" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-adbc8c5d-3063-4588-9635-a32cf93b690d" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-adbc8c5d-3063-4588-9635-a32cf93b690d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Deleting offline snapshot adbc8c5d-3063-4588-9635-a32cf93b690d of volume 67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:29 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] snapshot_file for this snap is: volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.332s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Deleted volume successfully. Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c7c4f-d8bd-46aa-bd0a-51387b39ef59]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-923b809d-747a-4d23-97cc-e7c266d0717e tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-b63be495-c96f-478a-9312-3aeb56b9e24a-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:30 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d Jul 20 16:50:30 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:30 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da 1073741824" returned: 0 in 0.524s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:30 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:50:30 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:30 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d" returned: 0 in 0.472s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67abb256-8687-445d-bb82-9ebf7f1c0865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252626d-3a0c-419b-8659-c44fad6a4a55]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:30 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:30 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:30 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.297s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd4bf04-2a9e-4d84-89cc-81b2c0ec1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59548176-bb3d-4ef9-9a94-7e74520c40da', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83aa84d-c300-42c9-8541-dc9d29dfce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Volume volume-59548176-bb3d-4ef9-9a94-7e74520c40da (59548176-bb3d-4ef9-9a94-7e74520c40da): created successfully Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83aa84d-c300-42c9-8541-dc9d29dfce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Flow 'volume_create_manager' (cf1db9ba-d7aa-4a63-a36b-abe47b126c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c196486d-7bdc-4d51-99be-da52ea51df6c tempest-VolumesActionsTest-774822187 None] Created volume successfully. Jul 20 16:50:30 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.392s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:30 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d Jul 20 16:50:30 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:31 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:31 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d Jul 20 16:50:31 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:31 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865.adbc8c5d-3063-4588-9635-a32cf93b690d" returned: 0 in 0.251s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-adbc8c5d-3063-4588-9635-a32cf93b690d" released by "_delete_snapshot" :: held 1.586s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-67abb256-8687-445d-bb82-9ebf7f1c0865" released by "delete_snapshot" :: held 1.617s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['7949b278-762a-4a87-a867-7de7586f3918', 'be99a38d-2e93-4799-81e7-28bf040f197b', '3430e932-a57d-408c-9e15-f5670bda75aa', '720ba3b3-e887-4ada-ba93-822e384ab608'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Delete snapshot completed successfully. Jul 20 16:50:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-540de624-ca76-4f8b-b636-4d5d3e4ed97f tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-adbc8c5d-3063-4588-9635-a32cf93b690d-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-67abb256-8687-445d-bb82-9ebf7f1c0865-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-67abb256-8687-445d-bb82-9ebf7f1c0865-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-67abb256-8687-445d-bb82-9ebf7f1c0865" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-67abb256-8687-445d-bb82-9ebf7f1c0865" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf9f8f-8f19-43b2-b1aa-b83702e6a9e2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:32 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:32 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Flow 'volume_create_manager' (1d7a5431-067b-4c05-85d7-f8cf61a9187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29924367-2f44-4508-8a66-71a85a326e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29924367-2f44-4508-8a66-71a85a326e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1241911165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a36383-d2e4-464c-8bd4-663704502ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ad768bfe2e4fb9b650db12fc347681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:32Z,use_quota=True,user_id='878d0cbd3c0842f084e0bd050675e813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de57d423-bf85-49af-b03b-58628f0411d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de57d423-bf85-49af-b03b-58628f0411d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13a871b-8f0b-40cf-a055-d96cb18916a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13a871b-8f0b-40cf-a055-d96cb18916a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a36383-d2e4-464c-8bd4-663704502ba8', 'volume_name': 'volume-44a36383-d2e4-464c-8bd4-663704502ba8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bd3281-fdc0-48cd-9b92-23ba25a69902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bd3281-fdc0-48cd-9b92-23ba25a69902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4d6672-72f1-498e-900a-f0caba6d8907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:32 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Volume 44a36383-d2e4-464c-8bd4-663704502ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a36383-d2e4-464c-8bd4-663704502ba8', 'volume_size': 1} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1241911165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a36383-d2e4-464c-8bd4-663704502ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ad768bfe2e4fb9b650db12fc347681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:32Z,use_quota=True,user_id='878d0cbd3c0842f084e0bd050675e813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Creating volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:32 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:32 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.399s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:32 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 1073741824 Jul 20 16:50:32 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:32 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865 Jul 20 16:50:32 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:32 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-67abb256-8687-445d-bb82-9ebf7f1c0865" returned: 0 in 0.272s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-67abb256-8687-445d-bb82-9ebf7f1c0865" released by "delete_volume" :: held 0.743s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['76e39f0b-dcab-46e1-9a52-b44de1ea8742', '8da34f6c-e3e9-47d4-a461-e7b6a3c09fc2', '131f2b4c-d1a4-4b45-b30f-8948b89c898d', '10ac49a3-81e9-4e88-9f42-9b116affdbe5'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:33 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 1073741824" returned: 0 in 0.515s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:33 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:33 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:33 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 Jul 20 16:50:33 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:33 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.349s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Deleted volume successfully. Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d7471678-1f85-4a0d-8e65-5c0619fb702c tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-67abb256-8687-445d-bb82-9ebf7f1c0865-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:33 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4d6672-72f1-498e-900a-f0caba6d8907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a36383-d2e4-464c-8bd4-663704502ba8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e7c1b1-06e6-4cb5-8683-d75bd820b2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:33 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Volume volume-44a36383-d2e4-464c-8bd4-663704502ba8 (44a36383-d2e4-464c-8bd4-663704502ba8): created successfully Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e7c1b1-06e6-4cb5-8683-d75bd820b2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Flow 'volume_create_manager' (1d7a5431-067b-4c05-85d7-f8cf61a9187b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-646d4004-8642-4d83-b29f-ed0370fd0120 tempest-SnapshotsActionsTest-2049121540 None] Created volume successfully. Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (30bf77a9-1405-4f08-8f6a-b51c38f7a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4683fa-7bb3-47c6-8d18-64da2e256b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4683fa-7bb3-47c6-8d18-64da2e256b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1942207010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641c2848-bf40-4e02-9b6a-8da861c40aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:34Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fb0084-e0a2-4144-9295-6bd3f6c560aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fb0084-e0a2-4144-9295-6bd3f6c560aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b3d3a3-a642-40c4-9377-a9c3ddf1e7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b3d3a3-a642-40c4-9377-a9c3ddf1e7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641c2848-bf40-4e02-9b6a-8da861c40aa0', 'volume_name': 'volume-641c2848-bf40-4e02-9b6a-8da861c40aa0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2570ab9a-cf19-42e9-9720-7d5118b74613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2570ab9a-cf19-42e9-9720-7d5118b74613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0dace0-5bfc-4d07-8950-4df24ada8d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:33 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Volume 641c2848-bf40-4e02-9b6a-8da861c40aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641c2848-bf40-4e02-9b6a-8da861c40aa0', 'volume_size': 1} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1942207010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641c2848-bf40-4e02-9b6a-8da861c40aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:34Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Creating volume 641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:33 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:50:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:34 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 1073741824 Jul 20 16:50:34 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:34 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 1073741824" returned: 0 in 0.544s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:34 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:34 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:34 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.071s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0dace0-5bfc-4d07-8950-4df24ada8d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641c2848-bf40-4e02-9b6a-8da861c40aa0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9390af8-21cc-4655-97d1-501f0b382d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Creating offline snapshot 7a8fc53a-6ea6-4c14-bc8b-f846b3095663 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:34 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Volume volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 (641c2848-bf40-4e02-9b6a-8da861c40aa0): created successfully Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9390af8-21cc-4655-97d1-501f0b382d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (30bf77a9-1405-4f08-8f6a-b51c38f7a76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b28cd63-88d2-4547-918c-c1a9b126f45c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-43144e91-595e-4f19-b0c6-d4d7f0de9bb2 tempest-VolumesSnapshotTestJSON-503306434 None] Created volume successfully. Jul 20 16:50:35 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 Jul 20 16:50:35 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:35 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8" returned: 0 in 0.479s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:35 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 1G Jul 20 16:50:35 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:35 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 1G" returned: 0 in 0.437s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:35 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:35 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:36 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.333s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:36 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 is being set with open permissions: ugo+rw Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:36 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:36 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:36 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.255s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:36 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info Jul 20 16:50:36 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:36 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info" returned: 0 in 0.302s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:36 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info is being set with open permissions: ugo+rw Jul 20 16:50:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:36 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info Jul 20 16:50:36 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:37 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.info" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.941s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Creating offline snapshot 3100623e-8f9c-4f2d-9300-494ef3f1dd9b of volume 641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2463097c-3169-4f73-8558-f097d0505fc8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:37 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9f57e500-6000-4a9e-9117-15de0d64f54c tempest-SnapshotsActionsTest-2049121540 None] Create snapshot completed successfully Jul 20 16:50:37 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:37 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:37 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.760s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:38 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b 1G Jul 20 16:50:38 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:38 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b 1G" returned: 0 in 0.678s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:38 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b Jul 20 16:50:38 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:39 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:39 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b is being set with open permissions: ugo+rw Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:39 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b Jul 20 16:50:39 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:39 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:39 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:39 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:39 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info Jul 20 16:50:39 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:39 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:50:39 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:39 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info is being set with open permissions: ugo+rw Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce2988f3-fe01-4d35-81d5-b62431c1ea51 tempest-VolumesActionsTest-774822187 None] Acquiring lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da" by "attach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:39 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info Jul 20 16:50:39 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce2988f3-fe01-4d35-81d5-b62431c1ea51 tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da" acquired by "attach_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ce2988f3-fe01-4d35-81d5-b62431c1ea51 tempest-VolumesActionsTest-774822187 None] Attaching volume 59548176-bb3d-4ef9-9a94-7e74520c40da to instance eb4e5007-3ddd-4c0b-9f6d-b32fb377b23a at mountpoint /dev/vdb on host None. Jul 20 16:50:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ce2988f3-fe01-4d35-81d5-b62431c1ea51 tempest-VolumesActionsTest-774822187 None] Attach volume completed successfully. Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ce2988f3-fe01-4d35-81d5-b62431c1ea51 tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da" released by "attach_volume" :: held 0.100s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:39 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.info" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.219s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-926c6375-aa22-42a6-9292-2d2e9e83f9a6 tempest-VolumesActionsTest-774822187 None] Acquiring lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-detach_volume" by "detach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Creating offline snapshot 5a319168-b838-4cb3-bccc-55db03dbf7b0 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-926c6375-aa22-42a6-9292-2d2e9e83f9a6 tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-926c6375-aa22-42a6-9292-2d2e9e83f9a6 tempest-VolumesActionsTest-774822187 None] Detaching volume 59548176-bb3d-4ef9-9a94-7e74520c40da from instance eb4e5007-3ddd-4c0b-9f6d-b32fb377b23a. Jul 20 16:50:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ca637296-d8ac-4f71-930e-cf498f0b7b27 tempest-VolumesSnapshotTestJSON-503306434 None] Create snapshot completed successfully Jul 20 16:50:40 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1d5e5-35c0-4f3e-b309-e14625f0322e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-926c6375-aa22-42a6-9292-2d2e9e83f9a6 tempest-VolumesActionsTest-774822187 None] Detach volume completed successfully. Jul 20 16:50:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-926c6375-aa22-42a6-9292-2d2e9e83f9a6 tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:40 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:40 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:40 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.498s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:40 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 1G Jul 20 16:50:40 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:41 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 1G" returned: 0 in 0.720s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:50:41 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 Jul 20 16:50:41 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (09a5c8c7-af0a-4c2c-a137-5dfadd94a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023fd4b5-949b-4a66-beaf-733ad20634aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023fd4b5-949b-4a66-beaf-733ad20634aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1986662931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4205d0-9e4a-4fce-8acc-d923dad7b7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1c025882b041b0b9399495ef9e61b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3100623e-8f9c-4f2d-9300-494ef3f1dd9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:50:41Z,use_quota=True,user_id='ea012b45d7b6415493a75f94faabb5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8cb39d-50c3-4057-bc2e-a0cc2515d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8cb39d-50c3-4057-bc2e-a0cc2515d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35e761e-65a4-4e18-95ba-5113a246f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35e761e-65a4-4e18-95ba-5113a246f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e4205d0-9e4a-4fce-8acc-d923dad7b7d3', 'volume_name': 'volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3', 'volume_size': 1, 'snapshot_id': '3100623e-8f9c-4f2d-9300-494ef3f1dd9b'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2892940a-11c6-494f-89df-4b31260238d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2892940a-11c6-494f-89df-4b31260238d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf1db3-0f6e-4a88-9dca-6321ddc7a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:41 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Volume 7e4205d0-9e4a-4fce-8acc-d923dad7b7d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3', 'volume_size': 1, 'snapshot_id': '3100623e-8f9c-4f2d-9300-494ef3f1dd9b'} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:41 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0" returned: 0 in 0.371s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:41 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 is being set with open permissions: ugo+rw Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:41 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 Jul 20 16:50:41 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:41 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0" returned: 0 in 0.329s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.579s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-3100623e-8f9c-4f2d-9300-494ef3f1dd9b-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8e1ff91b-abea-4472-82c0-5a7f8112d69c tempest-SnapshotsActionsTest-2049121540 None] Create snapshot completed successfully Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-3100623e-8f9c-4f2d-9300-494ef3f1dd9b-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Creating volume 7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 from snapshot 3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] snapshot: 3100623e-8f9c-4f2d-9300-494ef3f1dd9b, volume: 7e4205d0-9e4a-4fce-8acc-d923dad7b7d3, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ed54e2-c780-4aae-ac9e-acf46516d9be]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:42 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b Jul 20 16:50:42 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:42 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b" returned: 0 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-641c2848-bf40-4e02-9b6a-8da861c40aa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f20927d-4ae1-4608-a470-0b72018b5671]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:42 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:42 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:42 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:42 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 Jul 20 16:50:42 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-5a319168-b838-4cb3-bccc-55db03dbf7b0-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-5a319168-b838-4cb3-bccc-55db03dbf7b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-5a319168-b838-4cb3-bccc-55db03dbf7b0" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-5a319168-b838-4cb3-bccc-55db03dbf7b0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Deleting offline snapshot 5a319168-b838-4cb3-bccc-55db03dbf7b0 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] snapshot_file for this snap is: volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a99684-e86d-49f6-a62b-4c306f004ea0]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:43 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 Jul 20 16:50:43 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:43 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0" returned: 0 in 0.572s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b4ce1-cfcc-41f4-b9d0-e211f2569c15]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:44 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:44 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:44 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.993s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:44 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 Jul 20 16:50:44 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:45 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0" returned: 0 in 1.180s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:46 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0 Jul 20 16:50:46 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:46 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.5a319168-b838-4cb3-bccc-55db03dbf7b0" returned: 0 in 0.485s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-5a319168-b838-4cb3-bccc-55db03dbf7b0" released by "_delete_snapshot" :: held 3.432s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" released by "delete_snapshot" :: held 3.483s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:46 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Created reservations ['c00ce6a8-cbe3-49eb-8e9d-034e4232d357', '30c9d791-f835-491b-8a25-89cd3b797f7c', 'a05cae92-55e6-47b7-a5c3-771f8d7b7665', '64a807ba-78aa-44ca-b5f0-a7c890ea4e33'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Delete snapshot completed successfully. Jul 20 16:50:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4f4e4469-0e3a-45a5-82bb-cceb32a106d1 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-5a319168-b838-4cb3-bccc-55db03dbf7b0-delete_snapshot" released by "delete_snapshot" :: held 3.942s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:48 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" returned: 0 in 5.950s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:48 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239ace0-795b-43a6-881a-4fcfa13c3ae0]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:49 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:49 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:49 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.581s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:50:49 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Converted 1024.00 MB image at 172.08 MB/s Jul 20 16:50:49 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 is being set with open permissions: ugo+rw Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:49 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 Jul 20 16:50:49 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:49 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" returned: 0 in 0.258s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" released by "_copy_volume_from_snapshot" :: held 7.674s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-3100623e-8f9c-4f2d-9300-494ef3f1dd9b-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" released by "_create_volume_from_snapshot" :: held 7.705s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.739s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.482s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Creating offline snapshot d38f8ccd-726b-4b48-a981-608485037b48 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf1db3-0f6e-4a88-9dca-6321ddc7a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3', 'volume_size': 1, 'snapshot_id': '3100623e-8f9c-4f2d-9300-494ef3f1dd9b'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940b2187-2488-4121-bf2e-fdc1791e8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74812a2-fcf2-4bd8-9e13-081815f0011c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:49 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Volume volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 (7e4205d0-9e4a-4fce-8acc-d923dad7b7d3): created successfully Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940b2187-2488-4121-bf2e-fdc1791e8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:50:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Flow 'volume_create_manager' (09a5c8c7-af0a-4c2c-a137-5dfadd94a795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:50:49 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b04c85fe-9625-440f-b2bf-54b127411117 tempest-VolumesSnapshotTestJSON-503306434 None] Created volume successfully. Jul 20 16:50:49 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:49 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d621d00-4816-40ea-8c69-788c0f0eed1b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:50 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.465s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:50 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 1G Jul 20 16:50:50 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:50 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 Jul 20 16:50:50 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:50 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" returned: 0 in 0.406s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:50 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3 Jul 20 16:50:50 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:50 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 1G" returned: 0 in 0.473s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:50 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 Jul 20 16:50:50 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:50 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3" released by "delete_volume" :: held 0.754s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['6f615871-59ba-4d86-9330-b004a9ba8949', '3f388814-272f-42fa-bfda-561ea1232866', '99e636ee-d2f2-43ac-8137-592669ec0303', 'ec19a948-e9c0-4e92-8c60-874dfde5d62a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:51 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48" returned: 0 in 0.414s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:51 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 is being set with open permissions: ugo+rw Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:51 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:51 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:51 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 Jul 20 16:50:51 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-3100623e-8f9c-4f2d-9300-494ef3f1dd9b-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-3100623e-8f9c-4f2d-9300-494ef3f1dd9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-641c2848-bf40-4e02-9b6a-8da861c40aa0" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-641c2848-bf40-4e02-9b6a-8da861c40aa0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-3100623e-8f9c-4f2d-9300-494ef3f1dd9b" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-3100623e-8f9c-4f2d-9300-494ef3f1dd9b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Deleting offline snapshot 3100623e-8f9c-4f2d-9300-494ef3f1dd9b of volume 641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] snapshot_file for this snap is: volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:51 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48" returned: 0 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7426c525-a788-4f96-a021-f34314c0509a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:51 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.446s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Deleted volume successfully. Jul 20 16:50:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5b66854a-177e-45e1-8fbb-127d9c260bfe tempest-SnapshotsActionsTest-2049121540 None] Create snapshot completed successfully Jul 20 16:50:51 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b Jul 20 16:50:51 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41223a04-c72b-43ef-93cc-de75f71349ee tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-7e4205d0-9e4a-4fce-8acc-d923dad7b7d3-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:52 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b" returned: 0 in 0.585s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-641c2848-bf40-4e02-9b6a-8da861c40aa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89e951b-a3d1-434b-b8e5-fa6104a05510]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:52 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:52 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-d38f8ccd-726b-4b48-a981-608485037b48-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-d38f8ccd-726b-4b48-a981-608485037b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-d38f8ccd-726b-4b48-a981-608485037b48" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-d38f8ccd-726b-4b48-a981-608485037b48" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Deleting offline snapshot d38f8ccd-726b-4b48-a981-608485037b48 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] snapshot_file for this snap is: volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072c3f2-05b5-4885-9db9-81701a0e16c6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:52 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.791s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:52 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b Jul 20 16:50:53 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:53 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 Jul 20 16:50:53 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:53 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d7ef07-8699-40d5-a66c-57571c4d7b68]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:53 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b" returned: 0 in 0.472s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:53 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b Jul 20 16:50:53 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:53 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:53 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:53 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0.3100623e-8f9c-4f2d-9300-494ef3f1dd9b" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-3100623e-8f9c-4f2d-9300-494ef3f1dd9b" released by "_delete_snapshot" :: held 2.300s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-641c2848-bf40-4e02-9b6a-8da861c40aa0" released by "delete_snapshot" :: held 2.341s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['1b922b9d-5534-48c5-b4e1-8b77070ba8fa', '339bf298-cc07-4a7a-9550-ce48a20f4867', '31005fef-3c72-48a2-8a9f-c6ce02fb66d5', '2bb5cb89-3375-45e7-bc85-b7bfeedba43e'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:53 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.531s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:53 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 Jul 20 16:50:53 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:53 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Delete snapshot completed successfully. Jul 20 16:50:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-89918434-d53a-46d6-978c-c6067740d94d tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-3100623e-8f9c-4f2d-9300-494ef3f1dd9b-delete_snapshot" released by "delete_snapshot" :: held 2.560s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb53cb99-dbea-4e03-9601-0b456a252618 tempest-VolumesActionsTest-774822187 None] Acquiring lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da" by "attach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb53cb99-dbea-4e03-9601-0b456a252618 tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da" acquired by "attach_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bb53cb99-dbea-4e03-9601-0b456a252618 tempest-VolumesActionsTest-774822187 None] Attaching volume 59548176-bb3d-4ef9-9a94-7e74520c40da to instance ec527797-f7b8-4b70-a143-79a33ada6dba at mountpoint /dev/vdb on host None. Jul 20 16:50:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bb53cb99-dbea-4e03-9601-0b456a252618 tempest-VolumesActionsTest-774822187 None] Attach volume completed successfully. Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bb53cb99-dbea-4e03-9601-0b456a252618 tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da" released by "attach_volume" :: held 0.102s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:54 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48" returned: 0 in 0.471s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:54 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48 Jul 20 16:50:54 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05b08348-21d1-4990-9b0e-af37188a7cdc tempest-VolumesActionsTest-774822187 None] Acquiring lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-detach_volume" by "detach_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05b08348-21d1-4990-9b0e-af37188a7cdc tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-05b08348-21d1-4990-9b0e-af37188a7cdc tempest-VolumesActionsTest-774822187 None] Detaching volume 59548176-bb3d-4ef9-9a94-7e74520c40da from instance ec527797-f7b8-4b70-a143-79a33ada6dba. Jul 20 16:50:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-05b08348-21d1-4990-9b0e-af37188a7cdc tempest-VolumesActionsTest-774822187 None] Detach volume completed successfully. Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-05b08348-21d1-4990-9b0e-af37188a7cdc tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:54 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.d38f8ccd-726b-4b48-a981-608485037b48" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-d38f8ccd-726b-4b48-a981-608485037b48" released by "_delete_snapshot" :: held 1.987s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" released by "delete_snapshot" :: held 2.028s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-641c2848-bf40-4e02-9b6a-8da861c40aa0-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-641c2848-bf40-4e02-9b6a-8da861c40aa0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Created reservations ['c4d3c93c-e493-489d-ba91-558fb19b0835', 'af3e5b8a-6b48-4bff-b029-ce0db96d9479', '2938b2ab-08fb-4c89-ba58-aa02335073aa', '05c4d9bf-95f9-46f4-95da-3c4c5f8154bf'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-641c2848-bf40-4e02-9b6a-8da861c40aa0" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-641c2848-bf40-4e02-9b6a-8da861c40aa0" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[025fdf7c-6cb1-4f5a-a7b6-1525282bb9bf]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Delete snapshot completed successfully. Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5c2180be-1bf4-4927-89be-b89dc2722ed0 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-d38f8ccd-726b-4b48-a981-608485037b48-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:55 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:55 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:55 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.552s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:55 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0 Jul 20 16:50:55 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:55 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-641c2848-bf40-4e02-9b6a-8da861c40aa0" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-641c2848-bf40-4e02-9b6a-8da861c40aa0" released by "delete_volume" :: held 0.924s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:55 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['1b147648-a6e9-43ca-af56-5e7e6dca817c', 'e4e3946f-1877-4133-b3f6-6737143ca84e', 'ea3dc7da-c389-4166-b0d3-f8470cd72c9a', '50cf4e5d-1a50-4063-adf0-47bc9f31e655'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:56 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:56 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Creating offline snapshot 2df12bc5-f646-46f1-b6dd-cda6851cd29c of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:50:56 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba770fd-711e-4e7b-91bd-c4d0f14b0f45]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Deleted volume successfully. Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-375e9fb8-7388-48a0-967b-b05ed1523d12 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-641c2848-bf40-4e02-9b6a-8da861c40aa0-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:56 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:56 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:56 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.452s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:56 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c 1G Jul 20 16:50:56 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-0d4772df-885e-4ba4-ad7f-70123c3023fc-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-0d4772df-885e-4ba4-ad7f-70123c3023fc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "cinder-quobyte-0d4772df-885e-4ba4-ad7f-70123c3023fc" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-0d4772df-885e-4ba4-ad7f-70123c3023fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d7354d-e400-4235-8340-281ac0106245]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:57 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c 1G" returned: 0 in 0.519s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:57 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c Jul 20 16:50:57 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:57 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc Jul 20 16:50:57 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:57 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c" returned: 0 in 0.323s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:57 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c is being set with open permissions: ugo+rw Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:57 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:57 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c Jul 20 16:50:57 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:57 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc Jul 20 16:50:57 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:57 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.697s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:57 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0d4772df-885e-4ba4-ad7f-70123c3023fc" returned: 0 in 0.291s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-quobyte-0d4772df-885e-4ba4-ad7f-70123c3023fc" released by "delete_volume" :: held 0.753s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:58 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a7234c3c-9b2c-43a6-b352-2bbd9a28a206 tempest-SnapshotsActionsTest-2049121540 None] Create snapshot completed successfully Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Created reservations ['5b3b8bad-16e8-4550-af52-4c18b8989a18', 'eb9bb496-cf6b-43e7-ab2b-7979470d8574', '6a42e8bf-736c-4eb9-9fce-cb16c83a94db', '1e3fecd4-9061-4ca9-a52b-3f3efa0299ca'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:58 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:50:58 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:58 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:50:58 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Deleted volume successfully. Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32a18c13-dc81-4a5a-b32e-88e3859d4ad5 tempest-VolumesSnapshotTestJSON-503306434 None] Lock "cinder-0d4772df-885e-4ba4-ad7f-70123c3023fc-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-2df12bc5-f646-46f1-b6dd-cda6851cd29c-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-2df12bc5-f646-46f1-b6dd-cda6851cd29c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-2df12bc5-f646-46f1-b6dd-cda6851cd29c" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-2df12bc5-f646-46f1-b6dd-cda6851cd29c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Deleting offline snapshot 2df12bc5-f646-46f1-b6dd-cda6851cd29c of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] snapshot_file for this snap is: volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b7249-c884-4587-98b3-79ceac26a849]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:58 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c Jul 20 16:50:58 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:59 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c" returned: 0 in 0.401s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e99773c-b193-47d7-8a45-128410385010]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:59 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:50:59 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f33ca5-4843-4ef3-ab87-84eba214eae8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:59 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.435s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:59 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c Jul 20 16:50:59 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:59 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:50:59 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:50:59 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.414s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7113b-b96c-4bde-835e-2820a4477e5d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:50:59 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c" returned: 0 in 0.457s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:50:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:00 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c Jul 20 16:51:00 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:00 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:00 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:00 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.2df12bc5-f646-46f1-b6dd-cda6851cd29c" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-2df12bc5-f646-46f1-b6dd-cda6851cd29c" released by "_delete_snapshot" :: held 1.677s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" released by "delete_snapshot" :: held 1.713s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:00 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.416s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.168d4928-668a-47bc-bcf4-1c827ab7e493enxbea9i.img {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:00 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.168d4928-668a-47bc-bcf4-1c827ab7e493enxbea9i.img Jul 20 16:51:00 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Created reservations ['76a3af59-c91d-444c-8f0e-548f0ae8062e', '900e2681-7367-4ace-bc3e-431e648d31d0', '31484430-fef6-4cd5-bc75-115b5da146ab', 'ebb48285-505b-4352-a8ce-4f2bc6e402db'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Delete snapshot completed successfully. Jul 20 16:51:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e5ffed5d-15df-4729-8e89-9c03d87b6267 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-2df12bc5-f646-46f1-b6dd-cda6851cd29c-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:05 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.168d4928-668a-47bc-bcf4-1c827ab7e493enxbea9i.img" returned: 0 in 4.918s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc45f68-c047-4db9-9103-d8e64cb6d08a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:05 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:05 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:05 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.567s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:05 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.168d4928-668a-47bc-bcf4-1c827ab7e493enxbea9i.img {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:51:05 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Converted 1024.00 MB image at 208.17 MB/s Jul 20 16:51:05 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] 168d4928-668a-47bc-bcf4-1c827ab7e493 was raw, no need to convert to raw {{(pid=87535) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 20 16:51:10 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=143,cinder:UPDATE=147,cinder:INSERT=39,cinder:DELETE=10 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:51:15 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=151,cinder:UPDATE=150,cinder:INSERT=38,cinder:DELETE=13 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.681s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Uploaded volume to glance image-id: 168d4928-668a-47bc-bcf4-1c827ab7e493. {{(pid=87535) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.750s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Creating offline snapshot 50d40b9c-043c-4833-afd3-8e4b0a412d35 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:51:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1b6f90dd-bec6-4a9b-8f19-19cdbb08ffd3 tempest-VolumesActionsTest-774822187 None] Copy volume to image completed successfully. Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff0fc4-fc9c-4b3b-a2c0-08b145766a14]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:27 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:51:27 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:27 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:51:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:27 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 1G Jul 20 16:51:27 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:28 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 1G" returned: 0 in 0.484s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:28 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 Jul 20 16:51:28 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:28 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35" returned: 0 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:28 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 is being set with open permissions: ugo+rw Jul 20 16:51:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:28 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 Jul 20 16:51:28 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:28 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.600s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-36c99b03-c36f-448f-bfaf-fd788a5b0bc7 tempest-SnapshotsActionsTest-2049121540 None] Create snapshot completed successfully Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[61565488-1318-499e-bbc7-b2b83bdf5340]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:29 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:29 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:29 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e02479-e833-4f40-a8cd-d16b882fc7fc]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:29 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:29 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-50d40b9c-043c-4833-afd3-8e4b0a412d35-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-50d40b9c-043c-4833-afd3-8e4b0a412d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Acquiring lock "cinder-quobyte-50d40b9c-043c-4833-afd3-8e4b0a412d35" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-50d40b9c-043c-4833-afd3-8e4b0a412d35" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Deleting offline snapshot 50d40b9c-043c-4833-afd3-8e4b0a412d35 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] snapshot_file for this snap is: volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0c4f26-708c-436c-8534-096d53941c55]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:30 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 Jul 20 16:51:30 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:30 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.701s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:30 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img Jul 20 16:51:30 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:30 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35" returned: 0 in 0.564s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7805b3b-e140-4266-8a25-8d96cbeec505]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:30 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:51:30 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:31 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.869s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:51:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:31 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 Jul 20 16:51:31 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:32 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35" returned: 0 in 1.029s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:32 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35 Jul 20 16:51:32 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:33 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.50d40b9c-043c-4833-afd3-8e4b0a412d35" returned: 0 in 0.470s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-50d40b9c-043c-4833-afd3-8e4b0a412d35" released by "_delete_snapshot" :: held 3.125s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" released by "delete_snapshot" :: held 3.169s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Created reservations ['8c6ac8f0-7360-49f9-acb1-08b1d7060083', 'dc47f63f-f139-4ccb-818e-9f9f1c0a2fd4', '2236d6a2-14cd-459d-a1b9-d93eb80391f2', '1b753bc4-da3d-42be-9fb8-01e69a826658'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Delete snapshot completed successfully. Jul 20 16:51:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-29c9acf9-dc9e-4909-bdf5-c41dc055f300 tempest-SnapshotsActionsTest-183934182 None] Lock "cinder-50d40b9c-043c-4833-afd3-8e4b0a412d35-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "cinder-7a8fc53a-6ea6-4c14-bc8b-f846b3095663-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-7a8fc53a-6ea6-4c14-bc8b-f846b3095663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.205s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:36 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "cinder-quobyte-7a8fc53a-6ea6-4c14-bc8b-f846b3095663" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img" returned: 0 in 6.279s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-quobyte-7a8fc53a-6ea6-4c14-bc8b-f846b3095663" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Deleting offline snapshot 7a8fc53a-6ea6-4c14-bc8b-f846b3095663 of volume 44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] snapshot_file for this snap is: volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c6ab9-97d6-4db7-8aa9-0558885648f6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7d759-2676-4dec-97b0-5695356ab670]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:36 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:36 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:36 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:51:36 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:37 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.589s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a36383-d2e4-464c-8bd4-663704502ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d84775-ee45-462a-a349-9be1955e3416]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:37 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.696s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:51:37 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Converted 1024.00 MB image at 163.06 MB/s Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] 60cd94bd-88ec-4a28-9bd1-7af2525d208b was raw, converting to qcow2 {{(pid=87535) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a644c2-3117-444e-af63-71e4dac844c9]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:37 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 Jul 20 16:51:37 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:37 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img Jul 20 16:51:37 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:37 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8" returned: 0 in 0.487s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:37 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:51:37 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:37 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img" returned: 0 in 0.488s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:38 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img Jul 20 16:51:38 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:38 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.469s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:38 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img" returned: 1 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img /opt/stack/data/cinder/conversion/vol_upload_5dgz92te {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:38 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663 Jul 20 16:51:38 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:38 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img /opt/stack/data/cinder/conversion/vol_upload_5dgz92te Jul 20 16:51:38 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:38 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img /opt/stack/data/cinder/conversion/vol_upload_5dgz92te" returned: 0 in 0.344s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Image conversion details: src /opt/stack/data/cinder/conversion/59548176-bb3d-4ef9-9a94-7e74520c40da.temp_image.60cd94bd-88ec-4a28-9bd1-7af2525d208btkamk92g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5dgz92te {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:51:38 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[28baeb33-30e9-4eb3-b70f-b7f8c7822128]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5dgz92te {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:38 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8.7a8fc53a-6ea6-4c14-bc8b-f846b3095663" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-quobyte-7a8fc53a-6ea6-4c14-bc8b-f846b3095663" released by "_delete_snapshot" :: held 2.126s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" released by "delete_snapshot" :: held 2.156s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:38 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5dgz92te Jul 20 16:51:38 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:38 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Created reservations ['670c208c-8770-4b03-ac17-fbda12434657', '589f6aee-eeeb-4731-a09e-fab4fa7f84a9', '76ce4bbe-fcd8-4a56-b13d-609d808ff7ad', '1b46671d-fa7a-465b-8b38-5e5d5babc69b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Delete snapshot completed successfully. Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2ebd5037-948f-426d-becd-255075d7a8a6 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-7a8fc53a-6ea6-4c14-bc8b-f846b3095663-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:39 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5dgz92te" returned: 0 in 0.465s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:39 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:51:39 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Flow 'volume_create_manager' (450a7408-7913-44d8-ac41-e9c99996601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcdc0b2-f5c4-418c-b2e3-f75c2a613031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcdc0b2-f5c4-418c-b2e3-f75c2a613031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1245712046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e22b190-bf69-43d7-b105-ce3a73b1b120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5249be9fd1433ab76663acf3843f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:51:39Z,use_quota=True,user_id='759a70baaf4d4d6db42c873313d63249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54309b82-8f38-4fa7-8447-4b9e1a838274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54309b82-8f38-4fa7-8447-4b9e1a838274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104b902c-25b4-49ba-95ec-971fe3807dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104b902c-25b4-49ba-95ec-971fe3807dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e22b190-bf69-43d7-b105-ce3a73b1b120', 'volume_name': 'volume-1e22b190-bf69-43d7-b105-ce3a73b1b120', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecaeca0-a8df-46a1-86dc-2f4fb4b6594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecaeca0-a8df-46a1-86dc-2f4fb4b6594c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5057ab38-95b0-4917-9a03-092bbebeeb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:39 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Volume 1e22b190-bf69-43d7-b105-ce3a73b1b120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e22b190-bf69-43d7-b105-ce3a73b1b120', 'volume_size': 1} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:39 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.321s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "cinder-44a36383-d2e4-464c-8bd4-663704502ba8-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-44a36383-d2e4-464c-8bd4-663704502ba8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34a715-0e36-4498-90eb-da046c4f5c9a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:40 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 Jul 20 16:51:40 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:40 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8" returned: 0 in 0.406s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:40 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8 Jul 20 16:51:40 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:40 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-44a36383-d2e4-464c-8bd4-663704502ba8" returned: 0 in 0.260s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-quobyte-44a36383-d2e4-464c-8bd4-663704502ba8" released by "delete_volume" :: held 0.735s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Created reservations ['b63e15cf-6e9b-4cdc-a2cb-b688057e798c', '45f13931-5db8-42c8-89c4-71dbd21eff1f', '10ed9316-ca01-4b1b-97b7-37359f0405b0', 'ec85995a-de45-4322-9189-5dea4b9c3eb1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.620s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Uploaded volume to glance image-id: 60cd94bd-88ec-4a28-9bd1-7af2525d208b. {{(pid=87535) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1245712046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e22b190-bf69-43d7-b105-ce3a73b1b120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5249be9fd1433ab76663acf3843f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:51:39Z,use_quota=True,user_id='759a70baaf4d4d6db42c873313d63249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Creating volume 1e22b190-bf69-43d7-b105-ce3a73b1b120 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:51:40 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:40 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 1073741824 Jul 20 16:51:40 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6dc1588e-8d08-4b18-9a35-307c7011b114 tempest-VolumesActionsTest-774822187 None] Copy volume to image completed successfully. Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:40 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:51:40 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:41 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.361s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:51:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Deleted volume successfully. Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0421f5cd-c000-40c2-8a69-36b1b44103b7 tempest-SnapshotsActionsTest-2049121540 None] Lock "cinder-44a36383-d2e4-464c-8bd4-663704502ba8-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:41 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 1073741824" returned: 0 in 0.546s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:41 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 Jul 20 16:51:41 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:41 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5057ab38-95b0-4917-9a03-092bbebeeb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e22b190-bf69-43d7-b105-ce3a73b1b120', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dda87d-ca65-4c9c-828a-a84490d6a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:41 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Volume volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 (1e22b190-bf69-43d7-b105-ce3a73b1b120): created successfully Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dda87d-ca65-4c9c-828a-a84490d6a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Flow 'volume_create_manager' (450a7408-7913-44d8-ac41-e9c99996601d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Acquiring lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-de03279e-49b5-40ea-93d2-72583b2fa6aa tempest-TestMinimumBasicScenario-998744579 None] Created volume successfully. Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Acquiring lock "cinder-quobyte-59548176-bb3d-4ef9-9a94-7e74520c40da" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Lock "cinder-quobyte-59548176-bb3d-4ef9-9a94-7e74520c40da" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdf6df-0be9-40d6-a635-fefc5a9ce6a9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:42 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:42 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:42 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.524s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:42 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da Jul 20 16:51:42 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:42 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-59548176-bb3d-4ef9-9a94-7e74520c40da" returned: 0 in 0.344s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Lock "cinder-quobyte-59548176-bb3d-4ef9-9a94-7e74520c40da" released by "delete_volume" :: held 0.930s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:42 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Created reservations ['fa45c230-303d-41b0-abc8-5e3abd484f45', '3780120a-ef23-47fd-bd93-abc7e4a7cefd', '939033c0-b807-4c44-9267-117a48f362a2', '3fe87beb-f6d8-48ba-b6d9-a7498ebe1fe4'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:43 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:51:43 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:43 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:51:43 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Deleted volume successfully. Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cc28e5-2e8a-4070-93c4-1323fae9f37e tempest-VolumesActionsTest-774822187 None] Lock "cinder-59548176-bb3d-4ef9-9a94-7e74520c40da-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-4466f2e5-e3a3-4691-9ad1-291d3748a0f6 req-b613cfcf-53eb-47bc-a4cd-5661bab01af3 tempest-TestMinimumBasicScenario-998744579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-4466f2e5-e3a3-4691-9ad1-291d3748a0f6 req-b613cfcf-53eb-47bc-a4cd-5661bab01af3 tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-4466f2e5-e3a3-4691-9ad1-291d3748a0f6 req-b613cfcf-53eb-47bc-a4cd-5661bab01af3 tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-4466f2e5-e3a3-4691-9ad1-291d3748a0f6 req-b613cfcf-53eb-47bc-a4cd-5661bab01af3 tempest-TestMinimumBasicScenario-998744579 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-1e22b190-bf69-43d7-b105-ce3a73b1b120', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '712997a9-0894-499b-bd25-f78619962d0e', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:51:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-4466f2e5-e3a3-4691-9ad1-291d3748a0f6 req-b613cfcf-53eb-47bc-a4cd-5661bab01af3 tempest-TestMinimumBasicScenario-998744579 None] attachment_update completed successfully. Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (27e42c54-ee83-4027-bec4-04dee3ba4902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d3807b-334e-4041-ab0d-101027990c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d3807b-334e-4041-ab0d-101027990c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-993481906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96d1ba1-f20d-4737-93d3-aca51d6a606d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:51:53Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99d102a-f4fc-46a0-99b7-acdb87547c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99d102a-f4fc-46a0-99b7-acdb87547c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b099640-251c-4420-a393-2cb28a77bb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b099640-251c-4420-a393-2cb28a77bb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96d1ba1-f20d-4737-93d3-aca51d6a606d', 'volume_name': 'volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4607fefd-3fab-4275-b582-9473a872a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4607fefd-3fab-4275-b582-9473a872a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9240d824-f526-45d6-afb2-15cdeb3be5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:52 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Volume c96d1ba1-f20d-4737-93d3-aca51d6a606d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d', 'volume_size': 1} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-993481906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96d1ba1-f20d-4737-93d3-aca51d6a606d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:51:53Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Creating volume c96d1ba1-f20d-4737-93d3-aca51d6a606d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:51:52 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:51:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:52 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d 1073741824 Jul 20 16:51:52 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:53 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d 1073741824" returned: 0 in 0.475s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:53 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d Jul 20 16:51:53 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:53 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9240d824-f526-45d6-afb2-15cdeb3be5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a1165d-81aa-4032-bf47-418e6938e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:53 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Volume volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d (c96d1ba1-f20d-4737-93d3-aca51d6a606d): created successfully Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a1165d-81aa-4032-bf47-418e6938e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (27e42c54-ee83-4027-bec4-04dee3ba4902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:53 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3db420e1-770d-4340-b758-9b5bdc58d955 tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (d613eb89-b58b-44cc-9301-50e945a8d82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1f2cc0-e97b-4331-a1ee-b2616cecde37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1f2cc0-e97b-4331-a1ee-b2616cecde37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897706169',display_name='tempest-VolumesGetTest-Volume-1076331876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31b310e-ca00-4119-9f26-2f2829321e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:51:56Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e65a4c-9fc2-4b5a-a801-903e4fd2eb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e65a4c-9fc2-4b5a-a801-903e4fd2eb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfbb568-f8ac-477d-bfc2-d0780acca9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfbb568-f8ac-477d-bfc2-d0780acca9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31b310e-ca00-4119-9f26-2f2829321e83', 'volume_name': 'volume-a31b310e-ca00-4119-9f26-2f2829321e83', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6982fbb9-e65a-4f2b-8029-be1c8c7b83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6982fbb9-e65a-4f2b-8029-be1c8c7b83f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3be200-211e-4620-9bb5-7c0b89e9f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:55 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Volume a31b310e-ca00-4119-9f26-2f2829321e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31b310e-ca00-4119-9f26-2f2829321e83', 'volume_size': 1} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897706169',display_name='tempest-VolumesGetTest-Volume-1076331876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31b310e-ca00-4119-9f26-2f2829321e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:51:56Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Creating volume a31b310e-ca00-4119-9f26-2f2829321e83 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:51:55 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:51:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:55 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 1073741824 Jul 20 16:51:55 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:56 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 1073741824" returned: 0 in 0.456s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:56 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 Jul 20 16:51:56 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:56 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3be200-211e-4620-9bb5-7c0b89e9f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31b310e-ca00-4119-9f26-2f2829321e83', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c50366-d822-4118-a02d-858ed7a66037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Volume volume-a31b310e-ca00-4119-9f26-2f2829321e83 (a31b310e-ca00-4119-9f26-2f2829321e83): created successfully Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c50366-d822-4118-a02d-858ed7a66037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (d613eb89-b58b-44cc-9301-50e945a8d82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8e6624c8-5c53-4c9c-9a19-c02250c712cb tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-a31b310e-ca00-4119-9f26-2f2829321e83-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Lock "cinder-a31b310e-ca00-4119-9f26-2f2829321e83-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-a31b310e-ca00-4119-9f26-2f2829321e83" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-a31b310e-ca00-4119-9f26-2f2829321e83" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[975a91c6-c7a0-44d9-93c7-0b79333acbfb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:57 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 Jul 20 16:51:57 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:57 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83" returned: 0 in 0.413s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:57 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83 Jul 20 16:51:57 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:57 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a31b310e-ca00-4119-9f26-2f2829321e83" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-a31b310e-ca00-4119-9f26-2f2829321e83" released by "delete_volume" :: held 0.788s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Created reservations ['71edec1f-cb87-4f0d-88d1-50aaee52642a', '70fc3cc4-eb40-47e2-8b36-afe6347ad726', 'ae4c21b7-190c-4538-81cb-887f758f00c5', '300e63d3-cb81-4c86-a76a-e8d2e1eea489'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:57 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:51:57 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-c96d1ba1-f20d-4737-93d3-aca51d6a606d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Lock "cinder-c96d1ba1-f20d-4737-93d3-aca51d6a606d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:58 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:51:58 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f1e511ce-e051-408d-b762-73c56c84588d tempest-VolumesGetTest-301161672 None] Lock "cinder-a31b310e-ca00-4119-9f26-2f2829321e83-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-c96d1ba1-f20d-4737-93d3-aca51d6a606d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-c96d1ba1-f20d-4737-93d3-aca51d6a606d" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c9e06-7fe1-47d8-ae06-f87e1a52b43a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:58 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d Jul 20 16:51:58 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:58 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d" returned: 0 in 0.443s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:58 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d Jul 20 16:51:58 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:58 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c96d1ba1-f20d-4737-93d3-aca51d6a606d" returned: 0 in 0.268s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-c96d1ba1-f20d-4737-93d3-aca51d6a606d" released by "delete_volume" :: held 0.750s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Created reservations ['4173b447-ac74-4f58-abbd-65b647b3ebaf', 'deb72927-45e3-436e-b01d-9d102f8594a9', '450e0ea3-e4f5-4582-94f2-85f5138229c8', '6a291560-4ff1-4a96-80ca-1f703c00449b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:59 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:51:59 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:51:59 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.261s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:51:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-38e7f282-f286-4802-a3a4-2333d6e26089 tempest-VolumesGetTest-301161672 None] Lock "cinder-c96d1ba1-f20d-4737-93d3-aca51d6a606d-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (8039abeb-6d3c-4dd5-ba94-950985cfe92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a120f9b-d7a3-4d12-ae93-d1bef085340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a120f9b-d7a3-4d12-ae93-d1bef085340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-110166173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95678030-844b-45d3-8c9f-9a96ca3245e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:00Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c0354a-87dd-485e-96fc-fbefdf039be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c0354a-87dd-485e-96fc-fbefdf039be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8626a2b-426b-4823-a957-5179453737b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8626a2b-426b-4823-a957-5179453737b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95678030-844b-45d3-8c9f-9a96ca3245e3', 'volume_name': 'volume-95678030-844b-45d3-8c9f-9a96ca3245e3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921419b2-be2e-478e-bfc4-24c2a2afa70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921419b2-be2e-478e-bfc4-24c2a2afa70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e278be99-2afc-4c2a-8d8a-7651a90c2807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:51:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Volume 95678030-844b-45d3-8c9f-9a96ca3245e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95678030-844b-45d3-8c9f-9a96ca3245e3', 'volume_size': 1} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-110166173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95678030-844b-45d3-8c9f-9a96ca3245e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:00Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Creating volume 95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:51:59 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:51:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:51:59 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 1073741824 Jul 20 16:51:59 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:00 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 1073741824" returned: 0 in 0.590s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:00 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:00 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:00 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e278be99-2afc-4c2a-8d8a-7651a90c2807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95678030-844b-45d3-8c9f-9a96ca3245e3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33729423-090c-4848-b63b-f409068f9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:00 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Volume volume-95678030-844b-45d3-8c9f-9a96ca3245e3 (95678030-844b-45d3-8c9f-9a96ca3245e3): created successfully Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33729423-090c-4848-b63b-f409068f9da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (8039abeb-6d3c-4dd5-ba94-950985cfe92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f8b29ced-a240-46e9-8495-60e73e9537d7 tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Flow 'volume_create_manager' (c3897d56-2755-474c-aa1c-8d1ff29f49cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4169b2f-cbd7-4b7e-b226-88904f66e57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4169b2f-cbd7-4b7e-b226-88904f66e57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1356479747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e135b8-e274-4854-8017-a5a6bf3271c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e834422d84cae9f509a13f7ca81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:02Z,use_quota=True,user_id='73df846253f744c6ad9a17c2d3004f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2f79c-af56-4ef2-ae36-7528e119e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2f79c-af56-4ef2-ae36-7528e119e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd9679a-8721-40a7-b4c1-65b37e6ffb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd9679a-8721-40a7-b4c1-65b37e6ffb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e135b8-e274-4854-8017-a5a6bf3271c5', 'volume_name': 'volume-34e135b8-e274-4854-8017-a5a6bf3271c5', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370570c5-c09b-4889-9a7a-7b70c7eff246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370570c5-c09b-4889-9a7a-7b70c7eff246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45a66d5-60c4-4441-890c-5cd178917aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Volume 34e135b8-e274-4854-8017-a5a6bf3271c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e135b8-e274-4854-8017-a5a6bf3271c5', 'volume_size': 1} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1356479747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e135b8-e274-4854-8017-a5a6bf3271c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e834422d84cae9f509a13f7ca81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:02Z,use_quota=True,user_id='73df846253f744c6ad9a17c2d3004f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Creating volume 34e135b8-e274-4854-8017-a5a6bf3271c5 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:01 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:01 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 1073741824 Jul 20 16:52:01 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:02 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 1073741824" returned: 0 in 0.445s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (59f74e79-71f9-479d-a69c-2fe1a047cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d0d988-fb11-424d-bdd4-4668afc13a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d0d988-fb11-424d-bdd4-4668afc13a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2035271238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3215df-7983-4204-876f-d6c465f48059,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=95678030-844b-45d3-8c9f-9a96ca3245e3,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:02Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1384961f-160b-4f94-bad4-b98819468291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1384961f-160b-4f94-bad4-b98819468291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c130d6-8396-4e75-a592-aaa51f6e596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c130d6-8396-4e75-a592-aaa51f6e596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fc3215df-7983-4204-876f-d6c465f48059', 'volume_name': 'volume-fc3215df-7983-4204-876f-d6c465f48059', 'volume_size': 1, 'source_volid': '95678030-844b-45d3-8c9f-9a96ca3245e3', 'source_volstatus': 'available'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a724b53a-2d02-4639-8115-9c0a6dc0141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a724b53a-2d02-4639-8115-9c0a6dc0141a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f7811-7278-4818-8be9-172b0696c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Volume fc3215df-7983-4204-876f-d6c465f48059: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fc3215df-7983-4204-876f-d6c465f48059', 'volume_size': 1, 'source_volid': '95678030-844b-45d3-8c9f-9a96ca3245e3', 'source_volstatus': 'available'} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:02 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 Jul 20 16:52:02 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:02 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.258s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:02 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Cloning volume 95678030-844b-45d3-8c9f-9a96ca3245e3 to volume fc3215df-7983-4204-876f-d6c465f48059 Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45a66d5-60c4-4441-890c-5cd178917aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e135b8-e274-4854-8017-a5a6bf3271c5', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b94afb2-9ec3-477d-b954-618e845b8c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Volume volume-34e135b8-e274-4854-8017-a5a6bf3271c5 (34e135b8-e274-4854-8017-a5a6bf3271c5): created successfully Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b94afb2-9ec3-477d-b954-618e845b8c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Flow 'volume_create_manager' (c3897d56-2755-474c-aa1c-8d1ff29f49cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Creating offline snapshot dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 of volume 95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:52:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b270eef0-eea6-483c-adee-3a71f096c8e1 tempest-VolumeQuotasAdminTestJSON-733158606 None] Created volume successfully. Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c30fab-671e-4dca-bdb2-477052243258]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:02 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:02 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:03 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:03 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 1G Jul 20 16:52:03 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:03 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 1G" returned: 0 in 0.414s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95678030-844b-45d3-8c9f-9a96ca3245e3 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:03 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95678030-844b-45d3-8c9f-9a96ca3245e3 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 Jul 20 16:52:03 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:03 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95678030-844b-45d3-8c9f-9a96ca3245e3 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:03 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 is being set with open permissions: ugo+rw Jul 20 16:52:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:03 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 Jul 20 16:52:03 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "cinder-34e135b8-e274-4854-8017-a5a6bf3271c5-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "cinder-34e135b8-e274-4854-8017-a5a6bf3271c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "cinder-quobyte-34e135b8-e274-4854-8017-a5a6bf3271c5" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "cinder-quobyte-34e135b8-e274-4854-8017-a5a6bf3271c5" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0d785-6996-4080-9c55-e0f2505fa5ad]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:04 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" returned: 0 in 0.322s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:04 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 Jul 20 16:52:04 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:04 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info Jul 20 16:52:04 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:04 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5" returned: 0 in 0.406s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:04 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:04 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info is being set with open permissions: ugo+rw Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:04 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5 Jul 20 16:52:04 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:04 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info Jul 20 16:52:04 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:04 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-34e135b8-e274-4854-8017-a5a6bf3271c5" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "cinder-quobyte-34e135b8-e274-4854-8017-a5a6bf3271c5" released by "delete_volume" :: held 0.703s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:04 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.info" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-fc3215df-7983-4204-876f-d6c465f48059" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-fc3215df-7983-4204-876f-d6c465f48059" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] snapshot: dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23, volume: fc3215df-7983-4204-876f-d6c465f48059, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[30976978-1946-4148-a4b1-ba9d707c332d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:04 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Created reservations ['58432855-badf-4385-b0db-5ce98366f62b', '5274d9f5-4b7b-48ce-918d-fe93bb0a29ad', '64791338-a545-4cee-831a-16f5aba15f14', '5c1506c6-c44e-4f72-b943-72abd2af39ed'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:05 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 Jul 20 16:52:05 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:05 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:05 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:05 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" returned: 0 in 0.533s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95678030-844b-45d3-8c9f-9a96ca3245e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:52:05 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.456s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26926b-a99c-4331-be3e-5cbabfa24011]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Deleted volume successfully. Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-30eb9484-93af-44d7-95a2-a5c8e20e50cc tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "cinder-34e135b8-e274-4854-8017-a5a6bf3271c5-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:05 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:05 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:05 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.492s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:52:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:06 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 Jul 20 16:52:06 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Flow 'volume_create_manager' (44999c14-9a18-4a39-b9d4-43d47334cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8d121b-26ac-402f-a957-90b9c8f6ba6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8d121b-26ac-402f-a957-90b9c8f6ba6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-593646097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fdc963-b7b8-4ff2-a70d-a88e071dbbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e834422d84cae9f509a13f7ca81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:06Z,use_quota=True,user_id='73df846253f744c6ad9a17c2d3004f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eaa5c71-3a5a-429e-9774-6015d7379f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eaa5c71-3a5a-429e-9774-6015d7379f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378a50f4-9ff5-4930-9699-293ea8c5fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378a50f4-9ff5-4930-9699-293ea8c5fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fdc963-b7b8-4ff2-a70d-a88e071dbbea', 'volume_name': 'volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00694d39-4cf3-4cff-8246-8f66c581fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00694d39-4cf3-4cff-8246-8f66c581fba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8048f13e-f9bb-40cc-8106-449a765dc20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Volume 76fdc963-b7b8-4ff2-a70d-a88e071dbbea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea', 'volume_size': 1} Jul 20 16:52:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:10 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059" returned: 0 in 4.748s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f09eefd-e35d-4596-85b7-dd61c10a0499]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:10 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:10 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:11 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.546s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:52:11 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Converted 1024.00 MB image at 215.63 MB/s Jul 20 16:52:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 is being set with open permissions: ugo+rw Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:11 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 Jul 20 16:52:11 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:11 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059" returned: 0 in 0.255s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-fc3215df-7983-4204-876f-d6c465f48059" released by "_copy_volume_from_snapshot" :: held 6.695s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Deleting offline snapshot dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 of volume 95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] snapshot_file for this snap is: volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f3a74b-56f8-4e34-b8f0-b2bcb57bf7d8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:11 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 Jul 20 16:52:11 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:11 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" returned: 0 in 0.371s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95678030-844b-45d3-8c9f-9a96ca3245e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f20ea7-ecc4-43ab-8534-44558c440598]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:12 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:12 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:12 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.381s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:12 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 Jul 20 16:52:12 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:12 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" returned: 0 in 0.320s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:12 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23 Jul 20 16:52:12 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:12 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3.dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-dfadded4-8cbf-4c50-b2d3-a3b2e67c5d23" released by "_delete_snapshot" :: held 1.399s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.284s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.731s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-593646097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fdc963-b7b8-4ff2-a70d-a88e071dbbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112e834422d84cae9f509a13f7ca81a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:06Z,use_quota=True,user_id='73df846253f744c6ad9a17c2d3004f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Creating volume 76fdc963-b7b8-4ff2-a70d-a88e071dbbea {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:13 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f7811-7278-4818-8be9-172b0696c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3215df-7983-4204-876f-d6c465f48059', 'volume_size': 1, 'source_volid': '95678030-844b-45d3-8c9f-9a96ca3245e3', 'source_volstatus': 'available'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:13 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea 1073741824 Jul 20 16:52:13 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c2e836-3faf-419b-8547-8c18d3c3ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Volume volume-fc3215df-7983-4204-876f-d6c465f48059 (fc3215df-7983-4204-876f-d6c465f48059): created successfully Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c2e836-3faf-419b-8547-8c18d3c3ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (59f74e79-71f9-479d-a69c-2fe1a047cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-da93b3b8-af28-4fb9-8db4-fd5cf010be3e tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:52:13 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea 1073741824" returned: 0 in 0.461s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:13 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea Jul 20 16:52:13 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:13 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8048f13e-f9bb-40cc-8106-449a765dc20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a4cd42-cac0-4585-9f68-eb9a855ed678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Volume volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea (76fdc963-b7b8-4ff2-a70d-a88e071dbbea): created successfully Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a4cd42-cac0-4585-9f68-eb9a855ed678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Flow 'volume_create_manager' (44999c14-9a18-4a39-b9d4-43d47334cc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-78e6158a-adbf-46ec-a46f-8c3856baa8f8 tempest-VolumeQuotasAdminTestJSON-733158606 None] Created volume successfully. Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (1b95b3c1-9a39-424b-97ae-d8e5c321f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b53f59-0e0f-4839-9028-6ce6f16c817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b53f59-0e0f-4839-9028-6ce6f16c817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-343734553',display_name='tempest-VolumesGetTest-Volume-357494023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa8ead5-e34b-443a-b2a1-53f7238f6bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:14Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f05772c-64ed-4b33-b1bf-80c3b9e5bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f05772c-64ed-4b33-b1bf-80c3b9e5bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634eb0ed-3ea3-4815-ad1a-65067d07367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634eb0ed-3ea3-4815-ad1a-65067d07367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa8ead5-e34b-443a-b2a1-53f7238f6bde', 'volume_name': 'volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8d576b-1fba-4969-a2f9-35f1899a7062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8d576b-1fba-4969-a2f9-35f1899a7062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84be1cfb-6674-4268-b82f-2b23be91370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Volume 0aa8ead5-e34b-443a-b2a1-53f7238f6bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde', 'volume_size': 1} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-343734553',display_name='tempest-VolumesGetTest-Volume-357494023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa8ead5-e34b-443a-b2a1-53f7238f6bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:14Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Creating volume 0aa8ead5-e34b-443a-b2a1-53f7238f6bde {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:14 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:14 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde 1073741824 Jul 20 16:52:14 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:14 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde 1073741824" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:14 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde Jul 20 16:52:14 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:14 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde" returned: 0 in 0.278s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84be1cfb-6674-4268-b82f-2b23be91370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36dc980-751a-4937-9b7d-03043e479035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Volume volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde (0aa8ead5-e34b-443a-b2a1-53f7238f6bde): created successfully Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36dc980-751a-4937-9b7d-03043e479035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (1b95b3c1-9a39-424b-97ae-d8e5c321f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-17dcb47e-0b05-41d9-890d-65dc61e849e9 tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-0aa8ead5-e34b-443a-b2a1-53f7238f6bde-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Lock "cinder-0aa8ead5-e34b-443a-b2a1-53f7238f6bde-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-0aa8ead5-e34b-443a-b2a1-53f7238f6bde" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-0aa8ead5-e34b-443a-b2a1-53f7238f6bde" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[02637e24-32dd-4985-a5dc-db108300c69c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:15 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde Jul 20 16:52:15 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f840178c-07af-40c2-9b0a-358f0da85b44 tempest-VolumeQuotasAdminTestJSON-629119248 None] Transfer volume completed successfully. Jul 20 16:52:15 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde" returned: 0 in 0.463s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:15 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde Jul 20 16:52:15 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:16 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0aa8ead5-e34b-443a-b2a1-53f7238f6bde" returned: 0 in 0.283s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Acquiring lock "cinder-76fdc963-b7b8-4ff2-a70d-a88e071dbbea-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-0aa8ead5-e34b-443a-b2a1-53f7238f6bde" released by "delete_volume" :: held 0.806s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Lock "cinder-76fdc963-b7b8-4ff2-a70d-a88e071dbbea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Acquiring lock "cinder-quobyte-76fdc963-b7b8-4ff2-a70d-a88e071dbbea" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Created reservations ['b982bbe5-1aa4-4265-9b4b-66be62f931fd', 'c5f62027-2d14-4168-91f1-a2ce320cd1d6', '3d0a9353-1c14-4f3b-885c-9696a8d12a1c', '0ebd5f03-bb16-428e-a991-907199b96a5a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Lock "cinder-quobyte-76fdc963-b7b8-4ff2-a70d-a88e071dbbea" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bfdb52-7b7a-4801-ba9d-e1c9f0842f2a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:16 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:16 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:16 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea Jul 20 16:52:16 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-fc3215df-7983-4204-876f-d6c465f48059-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Lock "cinder-fc3215df-7983-4204-876f-d6c465f48059-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-fc3215df-7983-4204-876f-d6c465f48059" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-fc3215df-7983-4204-876f-d6c465f48059" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197ad96-c914-447d-a020-daf502e2a890]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:16 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:16 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea" returned: 0 in 0.445s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:52:16 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea Jul 20 16:52:16 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d16ef23a-5650-4dc4-86f3-4ba276332d26 tempest-VolumesGetTest-301161672 None] Lock "cinder-0aa8ead5-e34b-443a-b2a1-53f7238f6bde-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:16 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 Jul 20 16:52:16 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:16 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-76fdc963-b7b8-4ff2-a70d-a88e071dbbea" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Lock "cinder-quobyte-76fdc963-b7b8-4ff2-a70d-a88e071dbbea" released by "delete_volume" :: held 0.780s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:17 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Created reservations ['a5e2c7f2-56e0-4375-b79f-46b158b6b41c', '3266cda6-6505-4901-be5a-1a95e92b0a2e', '926fdf20-5832-407d-b0fe-6edb6b3d4ebf', 'b6d5b5cc-53ce-4e1f-9afe-20e34f43c506'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:17 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059 Jul 20 16:52:17 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:17 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:17 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:17 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fc3215df-7983-4204-876f-d6c465f48059" returned: 0 in 0.279s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-fc3215df-7983-4204-876f-d6c465f48059" released by "delete_volume" :: held 0.724s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Created reservations ['31700e2b-dfa0-41ca-9f35-c3259107f7c9', 'd3a27462-0926-4c17-8fd3-dda1642bc0b2', 'bdcde5d7-2d3e-418e-a127-b2f97687be0e', '19765120-9194-4c1f-b1a2-6084e9a9a981'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:17 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.329s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Deleted volume successfully. Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-76b73c45-275b-45c3-8d01-826304782db0 tempest-VolumeQuotasAdminTestJSON-1691642802 None] Lock "cinder-76fdc963-b7b8-4ff2-a70d-a88e071dbbea-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:17 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:17 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-95678030-844b-45d3-8c9f-9a96ca3245e3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Lock "cinder-95678030-844b-45d3-8c9f-9a96ca3245e3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:17 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-95678030-844b-45d3-8c9f-9a96ca3245e3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-96b7edc1-61ff-4bd6-8b90-2abd036e5a33 tempest-VolumesGetTest-301161672 None] Lock "cinder-fc3215df-7983-4204-876f-d6c465f48059-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-95678030-844b-45d3-8c9f-9a96ca3245e3" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ca40d3-53e7-41fb-828f-b6e606e20364]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:18 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:18 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:18 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.413s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:18 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3 Jul 20 16:52:18 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:18 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-95678030-844b-45d3-8c9f-9a96ca3245e3" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-95678030-844b-45d3-8c9f-9a96ca3245e3" released by "delete_volume" :: held 0.743s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Created reservations ['7fc71811-39d8-40b5-86e2-9a96688fc7d3', '20066624-ab3f-4e98-858c-118d87a96621', '2e34c1ff-348a-4514-b6cb-2cfcbef1083b', 'f37e04b4-3383-40c3-98e6-09a3c35ba46d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:18 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:18 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:19 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.278s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9861c176-cc53-4a20-9e37-fff0bff9386c tempest-VolumesGetTest-301161672 None] Lock "cinder-95678030-844b-45d3-8c9f-9a96ca3245e3-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (1c5491ba-3a7b-4028-9bac-bb2fdf878d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3d209d-8c53-4dae-8c39-1a4e830a77bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3d209d-8c53-4dae-8c39-1a4e830a77bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1948674684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f85203-c366-4df8-80fe-d9c8148fefe3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:20Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4c11be-2c4b-4a92-ba1a-febf7dad17f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c4c11be-2c4b-4a92-ba1a-febf7dad17f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8483dae9-5bf4-4e7c-b6cb-685da215a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:19 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8483dae9-5bf4-4e7c-b6cb-685da215a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54f85203-c366-4df8-80fe-d9c8148fefe3', 'volume_name': 'volume-54f85203-c366-4df8-80fe-d9c8148fefe3', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fdfd42-a3a7-4dbf-92e3-0f800f63014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fdfd42-a3a7-4dbf-92e3-0f800f63014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332d3db7-0bda-4302-ac11-03915eb339c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:20 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Volume 54f85203-c366-4df8-80fe-d9c8148fefe3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54f85203-c366-4df8-80fe-d9c8148fefe3', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Trying to clone 54f85203-c366-4df8-80fe-d9c8148fefe3 from image aa995944-e655-43b4-81e9-d04027d5b275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:52:20 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Image download 20.69 MB at 20.69 MB/s Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c406c38-2269-4acf-9856-9c0a1cf9b64d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:20 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD Jul 20 16:52:20 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:21 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 is fetched for user 49507e2c67064f64a1c52ec2295a6270. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=91,cinder:UPDATE=120,cinder:DELETE=6,cinder:INSERT=28 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[25970e2a-648e-4407-bfed-7b8e79dfb675]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:21 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD Jul 20 16:52:21 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:21 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1948674684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f85203-c366-4df8-80fe-d9c8148fefe3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:20Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Creating volume 54f85203-c366-4df8-80fe-d9c8148fefe3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:21 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:21 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 1073741824 Jul 20 16:52:21 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:21 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 1073741824" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:22 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 Jul 20 16:52:22 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:22 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Attempting download of aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 54f85203-c366-4df8-80fe-d9c8148fefe3. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf7746-59f6-47d5-9ad0-f8b9d177bb42]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:22 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw Jul 20 16:52:22 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:22 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw" returned: 0 in 0.339s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:22 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw Jul 20 16:52:22 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:22 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw" returned: 1 in 0.324s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_6v6qrlnw' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[45779908-bc49-4dd7-9b78-87bf8ecea06a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:23 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD Jul 20 16:52:23 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:23 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:23 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] aa995944-e655-43b4-81e9-d04027d5b275 was qcow2, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:52:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:23 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 Jul 20 16:52:23 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Flow 'volume_create_manager' (8c84968a-e99f-4283-bff6-ddb2c03a7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f573db58-2465-424b-878d-6fdd567b02ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f573db58-2465-424b-878d-6fdd567b02ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-637892824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cc0ab9-203b-47d4-82ca-0a32280b5d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d4663c58d4edf8d00a74465dc9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:25Z,use_quota=True,user_id='0814c6c17c014b2cae8ed0fcae1d7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9140f54d-01b5-437f-93f4-caacbf37119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9140f54d-01b5-437f-93f4-caacbf37119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58135829-afc0-44d6-90c7-6fe1ab0f9fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58135829-afc0-44d6-90c7-6fe1ab0f9fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26cc0ab9-203b-47d4-82ca-0a32280b5d9b', 'volume_name': 'volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9187a9-ccb9-4ceb-9d60-9359083ea400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9187a9-ccb9-4ceb-9d60-9359083ea400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57e67df-cf21-444e-bda6-df450bfaeb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:24 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Volume 26cc0ab9-203b-47d4-82ca-0a32280b5d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b', 'volume_size': 1} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-637892824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cc0ab9-203b-47d4-82ca-0a32280b5d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5d4663c58d4edf8d00a74465dc9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:25Z,use_quota=True,user_id='0814c6c17c014b2cae8ed0fcae1d7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Creating volume 26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:24 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:24 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b 1073741824 Jul 20 16:52:24 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:25 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3" returned: 0 in 1.712s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_l50gl_31devstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:52:25 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Converted 112.00 MB image at 65.38 MB/s Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:25 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 1G Jul 20 16:52:25 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:25 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b 1073741824" returned: 0 in 0.454s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:25 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b Jul 20 16:52:25 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:25 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 1G" returned: 0 in 0.311s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Downloaded image aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 54f85203-c366-4df8-80fe-d9c8148fefe3 successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 for user 49507e2c67064f64a1c52ec2295a6270 is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Marking volume 54f85203-c366-4df8-80fe-d9c8148fefe3 as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Copying metadata from image aa995944-e655-43b4-81e9-d04027d5b275 to 54f85203-c366-4df8-80fe-d9c8148fefe3. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Creating volume glance metadata for volume 54f85203-c366-4df8-80fe-d9c8148fefe3 backed by image aa995944-e655-43b4-81e9-d04027d5b275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (332d3db7-0bda-4302-ac11-03915eb339c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f85203-c366-4df8-80fe-d9c8148fefe3', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19864eb-2572-4105-9390-1ad344392df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:25 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Volume volume-54f85203-c366-4df8-80fe-d9c8148fefe3 (54f85203-c366-4df8-80fe-d9c8148fefe3): created successfully Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19864eb-2572-4105-9390-1ad344392df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:25 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (1c5491ba-3a7b-4028-9bac-bb2fdf878d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" returned: 0 in 0.266s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9bbb2b55-7cef-4de3-a234-918f8b11c727 tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57e67df-cf21-444e-bda6-df450bfaeb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebb33ac-c127-4609-b3ec-190949a10739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:25 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Volume volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b (26cc0ab9-203b-47d4-82ca-0a32280b5d9b): created successfully Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ebb33ac-c127-4609-b3ec-190949a10739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Flow 'volume_create_manager' (8c84968a-e99f-4283-bff6-ddb2c03a7609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-adc199db-c2ee-40c0-80d7-2e0c8089cb09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Created volume successfully. Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Creating offline snapshot 17295563-a39e-44c4-b901-d974d76cb6a9 of volume 26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[458ab1a1-6458-4214-a396-65d01e8a9ab4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:25 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b Jul 20 16:52:25 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:26 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" returned: 0 in 0.415s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:26 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 1G Jul 20 16:52:26 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:26 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 1G" returned: 0 in 0.492s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:26 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 Jul 20 16:52:26 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=94,cinder:UPDATE=112,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (19d5ad27-a154-469d-92b3-dde388c7c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2899cb5-3da5-4165-9e0c-677d853fed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2899cb5-3da5-4165-9e0c-677d853fed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2081729968',display_name='tempest-VolumesGetTest-Volume-279026850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:27Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38a632c-c737-4632-a404-32e1f318e0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38a632c-c737-4632-a404-32e1f318e0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3eb2e3-289c-4bcd-819c-b64ca22f587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3eb2e3-289c-4bcd-819c-b64ca22f587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a', 'volume_name': 'volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cd0bff-77aa-4ab7-8b77-d2094bdb10fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cd0bff-77aa-4ab7-8b77-d2094bdb10fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80227f2c-7445-4430-901b-db760b948f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:27 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Volume b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a', 'volume_size': 1} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:27 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:27 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 is being set with open permissions: ugo+rw Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:27 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 Jul 20 16:52:27 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:27 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9" returned: 0 in 0.252s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:27 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info Jul 20 16:52:27 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:27 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:27 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info is being set with open permissions: ugo+rw Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:27 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info Jul 20 16:52:27 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:27 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.info" returned: 0 in 0.244s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2081729968',display_name='tempest-VolumesGetTest-Volume-279026850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba16b0e2ea740e78d1454e5a14b112d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:27Z,use_quota=True,user_id='49507e2c67064f64a1c52ec2295a6270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Creating volume b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:27 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:27 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a 1073741824 Jul 20 16:52:27 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a1100f3c-d977-4cb5-b120-3d9ae0a69d1a tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Create snapshot completed successfully Jul 20 16:52:28 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a 1073741824" returned: 0 in 0.409s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:28 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a Jul 20 16:52:28 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:28 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a" returned: 0 in 0.248s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80227f2c-7445-4430-901b-db760b948f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1cb116-4d79-4250-bb75-500e00ce1d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Volume volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a (b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a): created successfully Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1cb116-4d79-4250-bb75-500e00ce1d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Flow 'volume_create_manager' (19d5ad27-a154-469d-92b3-dde388c7c956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a80b0bd3-d4d3-4869-91ed-f03b3dacc50e tempest-VolumesGetTest-301161672 None] Created volume successfully. Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Lock "cinder-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e310f-6014-4778-b216-0a516f6f3f42]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:29 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a Jul 20 16:52:29 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "cinder-17295563-a39e-44c4-b901-d974d76cb6a9-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-17295563-a39e-44c4-b901-d974d76cb6a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "cinder-quobyte-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-quobyte-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "cinder-quobyte-17295563-a39e-44c4-b901-d974d76cb6a9" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-quobyte-17295563-a39e-44c4-b901-d974d76cb6a9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Deleting offline snapshot 17295563-a39e-44c4-b901-d974d76cb6a9 of volume 26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] snapshot_file for this snap is: volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567879c-856b-45a4-958f-bff1cfd8a9bd]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:29 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 Jul 20 16:52:29 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:29 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a" returned: 0 in 0.445s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:29 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a Jul 20 16:52:29 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:29 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9" returned: 0 in 0.401s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd881730-23c2-4213-b3ab-5f5a40f0929a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:30 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a" returned: 0 in 0.292s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a" released by "delete_volume" :: held 0.796s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Created reservations ['02cdf2b2-3205-4a5f-b12e-24d53514e16e', '833edde3-d4a3-4759-bc0d-e46d23dcb8bf', '7f43c6cb-97b5-4ffc-bb1d-af8d2f43864d', '030fbde7-e044-43d9-a6b8-108ebceacb5f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:30 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b Jul 20 16:52:30 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:30 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:30 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-54f85203-c366-4df8-80fe-d9c8148fefe3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:30 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" returned: 0 in 0.472s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Lock "cinder-54f85203-c366-4df8-80fe-d9c8148fefe3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:30 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 Jul 20 16:52:30 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Acquiring lock "cinder-quobyte-54f85203-c366-4df8-80fe-d9c8148fefe3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-54f85203-c366-4df8-80fe-d9c8148fefe3" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b5d2b9-3d81-4264-ab4a-641d83d95428]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:30 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.470s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:52:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-621ffe0f-6466-4c0a-97a2-ed75a8feeb8d tempest-VolumesGetTest-301161672 None] Lock "cinder-b9c46f43-67a9-4b3b-91e6-0f07a8a90d2a-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:30 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 Jul 20 16:52:30 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:31 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9" returned: 0 in 0.508s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:31 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9 Jul 20 16:52:31 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:31 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3" returned: 0 in 0.453s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:31 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3 Jul 20 16:52:31 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:31 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b.17295563-a39e-44c4-b901-d974d76cb6a9" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-quobyte-17295563-a39e-44c4-b901-d974d76cb6a9" released by "_delete_snapshot" :: held 1.810s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-quobyte-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" released by "delete_snapshot" :: held 1.833s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:31 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-54f85203-c366-4df8-80fe-d9c8148fefe3" returned: 0 in 0.274s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Lock "cinder-quobyte-54f85203-c366-4df8-80fe-d9c8148fefe3" released by "delete_volume" :: held 0.787s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Created reservations ['221600c8-48d9-4f6b-9b26-f7d16ad85d61', '7fb9b909-432d-4bb3-9fdc-b0f7e3c4938e', '2a93267f-b2b0-4a52-bc72-a0504bbf52aa', 'a469b3ec-c7e7-4f98-a8b5-3e47921d0835'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Created reservations ['972ea7b6-552c-4211-b35c-bd28f3d20e3b', 'ed79b5aa-7806-4254-bd82-cc2ded41cbde', '39d12f6b-0aff-46bd-9c63-85b05d3888b0', '51b045ea-11af-41aa-a921-c488f86ed13c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Delete snapshot completed successfully. Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a757cab-ffa6-49b4-b4d2-5c6ab4e7ae09 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-17295563-a39e-44c4-b901-d974d76cb6a9-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:31 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:31 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "cinder-26cc0ab9-203b-47d4-82ca-0a32280b5d9b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-26cc0ab9-203b-47d4-82ca-0a32280b5d9b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "cinder-quobyte-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-quobyte-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc1261a-6c0f-4f87-b124-ec4e6d5ca750]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:32 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.465s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Deleted volume successfully. Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b6abe7d7-e08f-43f6-a3bf-512cdadaa066 tempest-VolumesGetTest-301161672 None] Lock "cinder-54f85203-c366-4df8-80fe-d9c8148fefe3-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:32 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b Jul 20 16:52:32 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:32 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" returned: 0 in 0.449s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:32 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b Jul 20 16:52:32 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-264b8eba-acad-4e3f-94cf-b16c3e91558e req-9e94a12a-a551-4755-b322-c85031f2c5ce tempest-TestMinimumBasicScenario-998744579 None] Terminate volume connection completed successfully. Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-264b8eba-acad-4e3f-94cf-b16c3e91558e req-9e94a12a-a551-4755-b322-c85031f2c5ce tempest-TestMinimumBasicScenario-998744579 None] Deleting attachment 712997a9-0894-499b-bd25-f78619962d0e. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:52:32 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" returned: 0 in 0.314s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-quobyte-26cc0ab9-203b-47d4-82ca-0a32280b5d9b" released by "delete_volume" :: held 0.881s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Created reservations ['e0f05045-3eb6-436c-b2b0-63869c92b925', '288a160b-b0e9-4907-b161-38ea088cd8bf', '38baf737-9d53-4f16-8931-7a507d287782', 'd4876bf2-a51f-4dfc-b9ec-6086e415cbee'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:32 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:32 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:33 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.260s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Deleted volume successfully. Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8de535bd-756b-432c-bba7-f093e182c2d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-758493822 None] Lock "cinder-26cc0ab9-203b-47d4-82ca-0a32280b5d9b-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Acquiring lock "cinder-1e22b190-bf69-43d7-b105-ce3a73b1b120-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Lock "cinder-1e22b190-bf69-43d7-b105-ce3a73b1b120-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Acquiring lock "cinder-quobyte-1e22b190-bf69-43d7-b105-ce3a73b1b120" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Lock "cinder-quobyte-1e22b190-bf69-43d7-b105-ce3a73b1b120" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[908db111-095a-4b35-8890-a3d542ee75ce]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:33 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 Jul 20 16:52:33 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:33 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120" returned: 0 in 0.366s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:33 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120 Jul 20 16:52:33 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:34 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1e22b190-bf69-43d7-b105-ce3a73b1b120" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Lock "cinder-quobyte-1e22b190-bf69-43d7-b105-ce3a73b1b120" released by "delete_volume" :: held 0.689s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Created reservations ['2745fe41-1df2-4287-84b1-30f4ba530aed', 'e247936a-5f44-4d0b-a4b3-9a99bf9cb9c2', 'b266743d-7931-4e7d-a289-90bca48bf33c', '032c0578-2e1a-4dfe-8e9c-3b998dc1aa08'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:34 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:34 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:34 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.285s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Deleted volume successfully. Jul 20 16:52:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ecd1964e-9911-4702-9b6a-11b1325307cb tempest-TestMinimumBasicScenario-998744579 None] Lock "cinder-1e22b190-bf69-43d7-b105-ce3a73b1b120-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Flow 'volume_create_manager' (4f5fdc13-053b-4ae7-b0eb-209bc6a4b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b272d4-be19-4c2c-892b-fcc537a1d403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b272d4-be19-4c2c-892b-fcc537a1d403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-110990579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0018fb-94e4-471d-82d0-677c59a09e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cc2d3ff9a045f39aa127ea03498741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:35Z,use_quota=True,user_id='925f95e6e5e44e788a7eb88548bd5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9d257c-cdda-45fe-af6e-632c21b73b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9d257c-cdda-45fe-af6e-632c21b73b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c004195-219b-4e54-b427-4efbf8fccf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c004195-219b-4e54-b427-4efbf8fccf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0018fb-94e4-471d-82d0-677c59a09e8d', 'volume_name': 'volume-0f0018fb-94e4-471d-82d0-677c59a09e8d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b26df80-b5be-42a2-84e5-221093937837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b26df80-b5be-42a2-84e5-221093937837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc56f4e-0396-478e-b380-031544a3cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:35 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Volume 0f0018fb-94e4-471d-82d0-677c59a09e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0018fb-94e4-471d-82d0-677c59a09e8d', 'volume_size': 1} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-110990579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0018fb-94e4-471d-82d0-677c59a09e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cc2d3ff9a045f39aa127ea03498741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:35Z,use_quota=True,user_id='925f95e6e5e44e788a7eb88548bd5cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Creating volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:35 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:35 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d 1073741824 Jul 20 16:52:35 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:36 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d 1073741824" returned: 0 in 0.621s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:36 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d Jul 20 16:52:36 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:36 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d" returned: 0 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc56f4e-0396-478e-b380-031544a3cdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0018fb-94e4-471d-82d0-677c59a09e8d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc5ed69-67a4-4e72-b5c9-afb042f803b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:36 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Volume volume-0f0018fb-94e4-471d-82d0-677c59a09e8d (0f0018fb-94e4-471d-82d0-677c59a09e8d): created successfully Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc5ed69-67a4-4e72-b5c9-afb042f803b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:36 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Flow 'volume_create_manager' (4f5fdc13-053b-4ae7-b0eb-209bc6a4b74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-63712169-5801-41ed-9306-f34ba9baa9da tempest-VolumesSnapshotListTestJSON-1602765454 None] Created volume successfully. Jul 20 16:52:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Creating offline snapshot 4f0b02be-58ed-4fde-a7c1-1cec19e4fecb of volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:52:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a875530-3e32-4962-a50b-f5478a4347c4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:37 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d Jul 20 16:52:37 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:38 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d" returned: 0 in 0.397s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:38 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb 1G Jul 20 16:52:38 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:38 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb 1G" returned: 0 in 0.487s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:38 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:38 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:39 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.326s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:39 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb is being set with open permissions: ugo+rw Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:39 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:39 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:39 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:39 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:39 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.335s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:39 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.294s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:52:39 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:52:39 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:39 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:39 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info is being set with open permissions: ugo+rw Jul 20 16:52:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:39 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info Jul 20 16:52:39 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:40 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.info" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f6200260-5316-4122-badb-83d387c76d21 tempest-VolumesSnapshotListTestJSON-1602765454 None] Create snapshot completed successfully Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Creating offline snapshot fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 of volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f670b886-ae51-41c0-9253-e03f61388974]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:41 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:41 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:41 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.495s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:41 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 1G Jul 20 16:52:41 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:42 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 1G" returned: 0 in 0.488s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:42 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:42 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:42 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.366s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:42 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 is being set with open permissions: ugo+rw Jul 20 16:52:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:42 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:42 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:42 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.755s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f961b0b3-cfb0-4f9e-822e-daf31adf1c2c tempest-VolumesSnapshotListTestJSON-1602765454 None] Create snapshot completed successfully Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Creating offline snapshot 10967a34-0acd-4e88-ae3b-b7405f1e2ae9 of volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb575b5-f588-43c3-a118-bb95ce471de9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:43 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:43 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:43 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.406s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:43 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 1G Jul 20 16:52:43 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:44 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 1G" returned: 0 in 0.548s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:44 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 Jul 20 16:52:44 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:44 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9" returned: 0 in 0.363s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:44 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 is being set with open permissions: ugo+rw Jul 20 16:52:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:44 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 Jul 20 16:52:44 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:45 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9" returned: 0 in 0.285s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.723s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5a032c68-8ada-4903-9261-a6cb4cf6a85c tempest-VolumesSnapshotListTestJSON-1602765454 None] Create snapshot completed successfully Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-10967a34-0acd-4e88-ae3b-b7405f1e2ae9-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-10967a34-0acd-4e88-ae3b-b7405f1e2ae9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-10967a34-0acd-4e88-ae3b-b7405f1e2ae9" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-10967a34-0acd-4e88-ae3b-b7405f1e2ae9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Deleting offline snapshot 10967a34-0acd-4e88-ae3b-b7405f1e2ae9 of volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] snapshot_file for this snap is: volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[18412fa1-c32b-40c8-92e3-f7f894c0199a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:46 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 Jul 20 16:52:46 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:47 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dbba8f-38b5-4c51-9381-7fd53ef6f4a9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:47 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:47 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:47 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.406s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:47 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 Jul 20 16:52:47 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:48 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9" returned: 0 in 0.485s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:48 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9 Jul 20 16:52:48 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:48 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.10967a34-0acd-4e88-ae3b-b7405f1e2ae9" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-10967a34-0acd-4e88-ae3b-b7405f1e2ae9" released by "_delete_snapshot" :: held 1.710s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" released by "delete_snapshot" :: held 1.743s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Created reservations ['cbde97bd-5c90-4502-bbe1-9f95a68e1c88', '5818cda5-5d84-4644-a280-c90a4864ec26', 'e64544d8-6336-4894-871e-92f0bc5f16bd', '95dc2a3f-fdca-41d5-86e7-68d8707f3a20'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Delete snapshot completed successfully. Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ee06d2ea-8cd8-44f3-8d3c-724da5d0900b tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-10967a34-0acd-4e88-ae3b-b7405f1e2ae9-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Deleting offline snapshot fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 of volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] snapshot_file for this snap is: volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f22eb5-6274-4581-a94b-9a163e930804]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:49 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:49 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:49 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75fc8d6-5854-465c-aadd-7b3c35cc332b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:49 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:49 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:49 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.437s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:49 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:49 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:50 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.497s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:50 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753 Jul 20 16:52:50 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:50 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" returned: 0 in 0.274s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753" released by "_delete_snapshot" :: held 1.737s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" released by "delete_snapshot" :: held 1.765s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Created reservations ['3239fb21-8a25-4599-9b04-cbb92e9395dd', 'a9e723ea-478b-4988-8e5a-a10fc66fb259', '1ed987a2-1001-4a05-9666-d91735e37735', '06c880a1-a21e-4fd2-8185-3622eef5e9bb'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:50 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Delete snapshot completed successfully. Jul 20 16:52:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94beb5fe-6b79-40d7-8502-e9959de2a906 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-fb2c025c-d8a4-4cd8-8c5a-dcaf82c32753-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-4f0b02be-58ed-4fde-a7c1-1cec19e4fecb-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-4f0b02be-58ed-4fde-a7c1-1cec19e4fecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Deleting offline snapshot 4f0b02be-58ed-4fde-a7c1-1cec19e4fecb of volume 0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] snapshot_file for this snap is: volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef4900-5b94-4d26-b9b6-92ce95ff9ae2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:51 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:51 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:51 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.473s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0018fb-94e4-471d-82d0-677c59a09e8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec3db0-b6dc-4d1d-bdaa-32794c7798e1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:51 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d Jul 20 16:52:51 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:52 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:52 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:52 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:52 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:52 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb Jul 20 16:52:52 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:52 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d.4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" returned: 0 in 0.296s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-4f0b02be-58ed-4fde-a7c1-1cec19e4fecb" released by "_delete_snapshot" :: held 1.669s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" released by "delete_snapshot" :: held 1.701s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Created reservations ['c5b8bb61-b690-4645-8929-9a8f23816b18', '64934ce1-4fdf-4797-bc07-dfa5c3bcc169', 'a4e4d840-d606-4d2e-b1c9-83a34abcb174', '89464b90-0d59-49d0-9d21-bce2bc6c7aeb'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Delete snapshot completed successfully. Jul 20 16:52:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2b9f0d00-81aa-4201-a7c2-6c7b318bbf52 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-4f0b02be-58ed-4fde-a7c1-1cec19e4fecb-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-0f0018fb-94e4-471d-82d0-677c59a09e8d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-0f0018fb-94e4-471d-82d0-677c59a09e8d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Flow 'volume_create_manager' (74a0422a-6d5b-4d48-9a98-70a5ac1d2e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ee2bea-44d2-42c6-b3d2-df79bd4aa332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ee2bea-44d2-42c6-b3d2-df79bd4aa332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1257013481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911f0055-0a58-4592-a34a-c06a633a5dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5fd734185d4dad9d52728395964d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:53Z,use_quota=True,user_id='3afd3f8e014a49ec805594c11f9d8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5fbc05-9fd9-49fd-844f-7f7ce05a8caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5fbc05-9fd9-49fd-844f-7f7ce05a8caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7775b5e0-136a-4f42-8a52-b2435edc5a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7775b5e0-136a-4f42-8a52-b2435edc5a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911f0055-0a58-4592-a34a-c06a633a5dfc', 'volume_name': 'volume-911f0055-0a58-4592-a34a-c06a633a5dfc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8648ec-9017-4a24-8e4f-59f11264997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8648ec-9017-4a24-8e4f-59f11264997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232f89eb-f919-4731-98d4-bd3e77337004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:53 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Volume 911f0055-0a58-4592-a34a-c06a633a5dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911f0055-0a58-4592-a34a-c06a633a5dfc', 'volume_size': 1} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1257013481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911f0055-0a58-4592-a34a-c06a633a5dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5fd734185d4dad9d52728395964d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:53Z,use_quota=True,user_id='3afd3f8e014a49ec805594c11f9d8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Creating volume 911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:52:53 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" acquired by "delete_volume" :: waited 0.085s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:53 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc 1073741824 Jul 20 16:52:53 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8156dc-0f44-47c7-8333-52a5afc2bd5f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:53 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d Jul 20 16:52:53 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:54 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc 1073741824" returned: 0 in 0.604s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:54 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d" returned: 0 in 0.545s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:54 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d Jul 20 16:52:54 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:54 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:52:54 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:54 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.278s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:54 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232f89eb-f919-4731-98d4-bd3e77337004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911f0055-0a58-4592-a34a-c06a633a5dfc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9ca5f4-2235-45c2-ab64-926622c0eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0f0018fb-94e4-471d-82d0-677c59a09e8d" returned: 0 in 0.366s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-quobyte-0f0018fb-94e4-471d-82d0-677c59a09e8d" released by "delete_volume" :: held 1.004s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:54 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Volume volume-911f0055-0a58-4592-a34a-c06a633a5dfc (911f0055-0a58-4592-a34a-c06a633a5dfc): created successfully Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9ca5f4-2235-45c2-ab64-926622c0eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Flow 'volume_create_manager' (74a0422a-6d5b-4d48-9a98-70a5ac1d2e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a343cdbd-b77f-4011-9aa6-a7070e1286e7 tempest-VolumesCloneTest-1593678917 None] Created volume successfully. Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Created reservations ['351adb8b-ce27-4c26-9125-097350676db8', 'f298b828-94b4-4863-a8df-ad67459361d5', '43d0722a-a129-4342-9ed8-b3c4f7b1f322', '3b0de2a2-be04-4ffb-9ae7-4d1a2ad5a059'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:54 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:52:54 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:54 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.244s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:52:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Deleted volume successfully. Jul 20 16:52:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d4cd319a-f77d-4c74-bc6f-d69bc0b00994 tempest-VolumesSnapshotListTestJSON-1602765454 None] Lock "cinder-0f0018fb-94e4-471d-82d0-677c59a09e8d-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Flow 'volume_create_manager' (6f0e11ed-aba9-4c03-a2f8-80874c733a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83959e9c-3daf-4c79-9bd9-16089cfbe57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83959e9c-3daf-4c79-9bd9-16089cfbe57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-978603921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1ecc36-3d6c-4450-8ce6-da7be138e08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5fd734185d4dad9d52728395964d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=911f0055-0a58-4592-a34a-c06a633a5dfc,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:56Z,use_quota=True,user_id='3afd3f8e014a49ec805594c11f9d8302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147f9882-cb4d-425b-a7bb-11e6f25e436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147f9882-cb4d-425b-a7bb-11e6f25e436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69af254-663d-47c5-ab81-7da492a48d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69af254-663d-47c5-ab81-7da492a48d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'de1ecc36-3d6c-4450-8ce6-da7be138e08f', 'volume_name': 'volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f', 'volume_size': 2, 'source_volid': '911f0055-0a58-4592-a34a-c06a633a5dfc', 'source_volstatus': 'available'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6761809f-2fd6-4fac-b4b2-b91c3a57cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6761809f-2fd6-4fac-b4b2-b91c3a57cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3ee40e-bf2b-47f2-b7ce-fa50485e64be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Volume de1ecc36-3d6c-4450-8ce6-da7be138e08f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f', 'volume_size': 2, 'source_volid': '911f0055-0a58-4592-a34a-c06a633a5dfc', 'source_volstatus': 'available'} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:56 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Cloning volume 911f0055-0a58-4592-a34a-c06a633a5dfc to volume de1ecc36-3d6c-4450-8ce6-da7be138e08f Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Creating offline snapshot 55692215-0e1e-44fa-94a9-09fca0c2594a of volume 911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[da21552e-f4e0-4a7e-baea-c1a10ea217af]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:56 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:52:56 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:56 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.438s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:56 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a 1G Jul 20 16:52:56 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:57 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a 1G" returned: 0 in 0.486s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911f0055-0a58-4592-a34a-c06a633a5dfc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:57 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911f0055-0a58-4592-a34a-c06a633a5dfc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a Jul 20 16:52:57 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:57 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911f0055-0a58-4592-a34a-c06a633a5dfc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a" returned: 0 in 0.355s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:57 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a is being set with open permissions: ugo+rw Jul 20 16:52:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:57 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a Jul 20 16:52:57 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:57 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a" returned: 0 in 0.293s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:57 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info Jul 20 16:52:57 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:58 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info" returned: 0 in 0.295s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:58 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info is being set with open permissions: ugo+rw Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:58 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info Jul 20 16:52:58 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:58 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.info" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "cinder-quobyte-de1ecc36-3d6c-4450-8ce6-da7be138e08f" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-de1ecc36-3d6c-4450-8ce6-da7be138e08f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] snapshot: 55692215-0e1e-44fa-94a9-09fca0c2594a, volume: de1ecc36-3d6c-4450-8ce6-da7be138e08f, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf2f581-12fc-468e-a657-482783cc68e4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:58 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a Jul 20 16:52:58 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:58 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a" returned: 0 in 0.416s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-911f0055-0a58-4592-a34a-c06a633a5dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d712d2c5-8cbf-44ed-8903-2e21717b9f33]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:59 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:52:59 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Flow 'volume_create_manager' (81d0e337-9467-42c3-a035-398fb9b4fe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb6e040-1633-43f2-8b3c-19bb85c410f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb6e040-1633-43f2-8b3c-19bb85c410f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-156230509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7504f2a-a94c-4f4b-8350-24542a3b6737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140799d140864d82af66d33506742cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:59Z,use_quota=True,user_id='cd464810c5ba43f08f02d926019df42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123d4c5e-d625-462e-bd1a-0ec7126a833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123d4c5e-d625-462e-bd1a-0ec7126a833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf57409-9116-44e3-9540-e0102c376c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf57409-9116-44e3-9540-e0102c376c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7504f2a-a94c-4f4b-8350-24542a3b6737', 'volume_name': 'volume-b7504f2a-a94c-4f4b-8350-24542a3b6737', 'volume_size': 2}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7043639f-2685-45b3-adf9-497159d4f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7043639f-2685-45b3-adf9-497159d4f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:52:59 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a764fbe-d3ec-447d-9efe-b3e8a21fe7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:52:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Volume b7504f2a-a94c-4f4b-8350-24542a3b6737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7504f2a-a94c-4f4b-8350-24542a3b6737', 'volume_size': 2} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.577s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:52:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:52:59 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f Jul 20 16:52:59 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:04 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f" returned: 0 in 5.126s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:04 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3a9773-b668-41ed-b1b0-f8bbccaeb0fa]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:04 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:53:04 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:05 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.546s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:53:05 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Converted 1024.00 MB image at 199.69 MB/s Jul 20 16:53:05 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f is being set with open permissions: ugo+rw Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:05 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f Jul 20 16:53:05 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:05 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f" returned: 0 in 0.241s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-de1ecc36-3d6c-4450-8ce6-da7be138e08f" released by "_copy_volume_from_snapshot" :: held 7.017s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "cinder-quobyte-55692215-0e1e-44fa-94a9-09fca0c2594a" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-55692215-0e1e-44fa-94a9-09fca0c2594a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Deleting offline snapshot 55692215-0e1e-44fa-94a9-09fca0c2594a of volume 911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] snapshot_file for this snap is: volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ea7c3-4a4c-46b2-b493-1fba82bdfb7f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:05 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a Jul 20 16:53:05 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:06 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a" returned: 0 in 0.413s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-911f0055-0a58-4592-a34a-c06a633a5dfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ebe613-0b26-48f5-bc56-5536f50cb467]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:06 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:53:06 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:06 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:06 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a Jul 20 16:53:06 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:06 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a" returned: 0 in 0.335s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:06 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a Jul 20 16:53:06 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:07 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc.55692215-0e1e-44fa-94a9-09fca0c2594a" returned: 0 in 0.401s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-55692215-0e1e-44fa-94a9-09fca0c2594a" released by "_delete_snapshot" :: held 1.619s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.984s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.642s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-156230509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7504f2a-a94c-4f4b-8350-24542a3b6737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140799d140864d82af66d33506742cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:52:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:52:59Z,use_quota=True,user_id='cd464810c5ba43f08f02d926019df42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Creating volume b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:07 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 2147483648 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3ee40e-bf2b-47f2-b7ce-fa50485e64be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f', 'volume_size': 2, 'source_volid': '911f0055-0a58-4592-a34a-c06a633a5dfc', 'source_volstatus': 'available'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:07 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 2147483648 Jul 20 16:53:07 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09031179-e193-4a14-a6e6-9e9abac5b99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Volume volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f (de1ecc36-3d6c-4450-8ce6-da7be138e08f): created successfully Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09031179-e193-4a14-a6e6-9e9abac5b99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Flow 'volume_create_manager' (6f0e11ed-aba9-4c03-a2f8-80874c733a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-94190dd6-857f-4230-85f0-56cda3365ab6 tempest-VolumesCloneTest-1593678917 None] Created volume successfully. Jul 20 16:53:07 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 2147483648" returned: 0 in 0.521s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:07 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 Jul 20 16:53:07 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:08 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a764fbe-d3ec-447d-9efe-b3e8a21fe7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7504f2a-a94c-4f4b-8350-24542a3b6737', 'volume_size': 2}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb8b41f-9d8c-4aba-8831-76a211de9cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:08 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Volume volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 (b7504f2a-a94c-4f4b-8350-24542a3b6737): created successfully Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb8b41f-9d8c-4aba-8831-76a211de9cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Flow 'volume_create_manager' (81d0e337-9467-42c3-a035-398fb9b4fe0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7e0c9539-db0e-4861-8b04-4c8b34c4e47a tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Created volume successfully. Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Acquiring lock "cinder-de1ecc36-3d6c-4450-8ce6-da7be138e08f-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Lock "cinder-de1ecc36-3d6c-4450-8ce6-da7be138e08f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Acquiring lock "cinder-quobyte-de1ecc36-3d6c-4450-8ce6-da7be138e08f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-de1ecc36-3d6c-4450-8ce6-da7be138e08f" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d332839-7d61-490d-92f6-7fef20d9fa1c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:08 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f Jul 20 16:53:08 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:08 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:08 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f Jul 20 16:53:08 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:09 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de1ecc36-3d6c-4450-8ce6-da7be138e08f" returned: 0 in 0.279s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-de1ecc36-3d6c-4450-8ce6-da7be138e08f" released by "delete_volume" :: held 0.725s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Created reservations ['0f828e30-2ea0-4d8d-a2a0-6ea0d0dee304', '1d89aa88-6063-4cff-bd71-ff141d912a5b', '4268645b-4a7d-44d3-8bf2-4dac321a68b8', '24c8a0f5-80be-4c52-bc78-4706e98f334f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:09 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:09 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Creating offline snapshot 46316f6c-02ff-49ad-a2a2-14dd4bf87b9a of volume b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2276c8-53b4-4f20-a085-06bb3e2eb442]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:09 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.299s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Deleted volume successfully. Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8716ad49-2b8e-45e6-8c7b-0b528d86c23e tempest-VolumesCloneTest-1593678917 None] Lock "cinder-de1ecc36-3d6c-4450-8ce6-da7be138e08f-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:09 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 Jul 20 16:53:09 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "cinder-911f0055-0a58-4592-a34a-c06a633a5dfc-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-911f0055-0a58-4592-a34a-c06a633a5dfc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "cinder-quobyte-911f0055-0a58-4592-a34a-c06a633a5dfc" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-911f0055-0a58-4592-a34a-c06a633a5dfc" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7318a-11de-43a1-bc92-999f4ab624f1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:10 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:53:10 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:10 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737" returned: 0 in 0.441s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a 2G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:10 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a 2G Jul 20 16:53:10 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:10 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:10 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc Jul 20 16:53:10 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:10 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a 2G" returned: 0 in 0.505s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:10 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a Jul 20 16:53:10 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:10 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-911f0055-0a58-4592-a34a-c06a633a5dfc" returned: 0 in 0.306s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-quobyte-911f0055-0a58-4592-a34a-c06a633a5dfc" released by "delete_volume" :: held 0.773s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Created reservations ['6bc945de-31a2-469a-a34e-9eac9f6ef881', '975885e0-6901-4a43-9a3d-02bdfe42be53', '5af88da0-db01-4a48-8451-5863fa5e8820', 'd5d6a278-48ef-4092-82d3-63c60f23e45c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:10 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:10 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:10 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:10 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a is being set with open permissions: ugo+rw Jul 20 16:53:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:10 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a Jul 20 16:53:10 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:11 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Deleted volume successfully. Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6ddf4131-3713-4b6f-a517-e781c3ac8b46 tempest-VolumesCloneTest-1593678917 None] Lock "cinder-911f0055-0a58-4592-a34a-c06a633a5dfc-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:11 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" returned: 0 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:11 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info Jul 20 16:53:11 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:11 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info" returned: 0 in 0.285s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info is being set with open permissions: ugo+rw Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:11 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info Jul 20 16:53:11 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:11 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.info" returned: 0 in 0.307s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-81f6f120-faa6-4dac-a4e4-2c566ee78411 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Create snapshot completed successfully Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "cinder-46316f6c-02ff-49ad-a2a2-14dd4bf87b9a-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-46316f6c-02ff-49ad-a2a2-14dd4bf87b9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "cinder-quobyte-b7504f2a-a94c-4f4b-8350-24542a3b6737" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-quobyte-b7504f2a-a94c-4f4b-8350-24542a3b6737" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "cinder-quobyte-46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-quobyte-46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Deleting offline snapshot 46316f6c-02ff-49ad-a2a2-14dd4bf87b9a of volume b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] snapshot_file for this snap is: volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d663508-aaf2-438d-864f-5d8e274ce6ce]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:13 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a Jul 20 16:53:13 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:13 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" returned: 0 in 0.514s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7504f2a-a94c-4f4b-8350-24542a3b6737(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:53:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[48092d49-02d0-4591-9d38-06bc85b09f64]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:13 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 Jul 20 16:53:13 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:13 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737" returned: 0 in 0.421s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:13 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a Jul 20 16:53:13 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Flow 'volume_create_manager' (ebf61d2a-0060-4cf6-a3d5-1d0e203c3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5109ce-4e29-42ed-a17b-8544116980d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5109ce-4e29-42ed-a17b-8544116980d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-63901658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4642c64-8c2d-43c0-8b6f-02ce11cce7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8833e7d7d44ab084c7e6199948ee36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:14Z,use_quota=True,user_id='d19260bb697949bcb68246e31c865265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22abeddd-5a29-44c0-a066-a6e66a498ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22abeddd-5a29-44c0-a066-a6e66a498ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3685cc8-c001-4e7f-b87f-a997421bf2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3685cc8-c001-4e7f-b87f-a997421bf2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4642c64-8c2d-43c0-8b6f-02ce11cce7c7', 'volume_name': 'volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7', 'volume_size': 2}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6134c343-7858-4c24-ad12-10768755c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6134c343-7858-4c24-ad12-10768755c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cb3aab-bdbd-4a1e-8e44-7597ad0082cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Volume c4642c64-8c2d-43c0-8b6f-02ce11cce7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7', 'volume_size': 2} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-63901658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4642c64-8c2d-43c0-8b6f-02ce11cce7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8833e7d7d44ab084c7e6199948ee36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:14Z,use_quota=True,user_id='d19260bb697949bcb68246e31c865265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Creating volume c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:14 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 2147483648 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:14 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:14 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 2147483648 Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" returned: 0 in 0.396s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:14 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:14 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a Jul 20 16:53:14 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:14 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737.46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" returned: 0 in 0.273s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-quobyte-46316f6c-02ff-49ad-a2a2-14dd4bf87b9a" released by "_delete_snapshot" :: held 1.772s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-quobyte-b7504f2a-a94c-4f4b-8350-24542a3b6737" released by "delete_snapshot" :: held 1.807s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Created reservations ['93e06846-f495-4cf9-94cb-ff4cb591f430', '5032bfde-aaea-4632-8851-421e5fe00857', '4774597b-9b2f-40bc-80ab-3b3058cd32f8', '5ee52c5c-9bc3-4afd-bf0d-4e088c6f8a21'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Delete snapshot completed successfully. Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-22d7be86-d965-4ee0-ac09-9a7190d34cbd tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-46316f6c-02ff-49ad-a2a2-14dd4bf87b9a-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:14 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 2147483648" returned: 0 in 0.600s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:14 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 Jul 20 16:53:14 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "cinder-b7504f2a-a94c-4f4b-8350-24542a3b6737-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-b7504f2a-a94c-4f4b-8350-24542a3b6737-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "cinder-quobyte-b7504f2a-a94c-4f4b-8350-24542a3b6737" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-quobyte-b7504f2a-a94c-4f4b-8350-24542a3b6737" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:15 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7" returned: 0 in 0.320s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfccf51-303a-4b1f-a18e-77b534846616]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cb3aab-bdbd-4a1e-8e44-7597ad0082cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7', 'volume_size': 2}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e291f7af-be6c-47dc-a8ae-d7bdb89eb56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Volume volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 (c4642c64-8c2d-43c0-8b6f-02ce11cce7c7): created successfully Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e291f7af-be6c-47dc-a8ae-d7bdb89eb56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Flow 'volume_create_manager' (ebf61d2a-0060-4cf6-a3d5-1d0e203c3884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-61ea8d1b-983f-4130-a522-5e15b20fb13e tempest-VolumesCloneNegativeTest-1339057378 None] Created volume successfully. Jul 20 16:53:15 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 Jul 20 16:53:15 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:15 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:15 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737 Jul 20 16:53:15 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:15 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b7504f2a-a94c-4f4b-8350-24542a3b6737" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-quobyte-b7504f2a-a94c-4f4b-8350-24542a3b6737" released by "delete_volume" :: held 0.715s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Created reservations ['3abc47b7-eee3-4e86-bb58-1fae94b9da8f', 'b9f5646b-4a39-4753-923f-983ba2fa87fa', '776e5bc2-eac4-4150-a07f-139005d79d18', '01fd7345-efbb-48fd-bc3d-14d2165a66f8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:16 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:16 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:16 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.253s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Deleted volume successfully. Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7a07623f-c735-4882-a070-b89b96362da5 tempest-VolumesSnapshotNegativeTestJSON-200353525 None] Lock "cinder-b7504f2a-a94c-4f4b-8350-24542a3b6737-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Acquiring lock "cinder-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Lock "cinder-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Acquiring lock "cinder-quobyte-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Lock "cinder-quobyte-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60d4e5-a0b2-447b-ac61-eb194e08a1ed]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:16 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 Jul 20 16:53:16 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Flow 'volume_create_manager' (409f3495-4c9c-4b23-810a-1f17a61d357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508f20ce-bf76-4567-8b5b-91c7747d36e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508f20ce-bf76-4567-8b5b-91c7747d36e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2034243333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106d18f6-47ac-4f01-a59f-ccace072a32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a69da93c34935b4846140b2c8345b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:17Z,use_quota=True,user_id='c4034241dbf54457af84c78afbce8114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00f8dce-82c7-4976-ad9e-dfcd7b5d9e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00f8dce-82c7-4976-ad9e-dfcd7b5d9e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320c3a7-e505-4c39-b18c-b7cc0e1daede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6320c3a7-e505-4c39-b18c-b7cc0e1daede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106d18f6-47ac-4f01-a59f-ccace072a32a', 'volume_name': 'volume-106d18f6-47ac-4f01-a59f-ccace072a32a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28810402-66ed-4bab-8a89-285217aca426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28810402-66ed-4bab-8a89-285217aca426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d78fe2-1bf4-4910-9145-2b80bd58cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Volume 106d18f6-47ac-4f01-a59f-ccace072a32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106d18f6-47ac-4f01-a59f-ccace072a32a', 'volume_size': 1} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2034243333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106d18f6-47ac-4f01-a59f-ccace072a32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a69da93c34935b4846140b2c8345b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:17Z,use_quota=True,user_id='c4034241dbf54457af84c78afbce8114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Creating volume 106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:16 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:16 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a 1073741824 Jul 20 16:53:16 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:17 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7" returned: 0 in 0.492s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:17 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7 Jul 20 16:53:17 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:17 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Lock "cinder-quobyte-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7" released by "delete_volume" :: held 0.894s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:17 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a 1073741824" returned: 0 in 0.576s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Created reservations ['e795485b-5406-4736-8175-51a2b29d4e26', 'ac1bb39a-7832-4c3b-a3f6-2678c558f47c', 'b5d5300f-0bc1-4384-85b1-6597a9d4b064', 'ce9bb033-88b0-4861-96f6-ac486cc53aa0'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:17 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:53:17 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:17 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:17 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:17 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.371s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d78fe2-1bf4-4910-9145-2b80bd58cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106d18f6-47ac-4f01-a59f-ccace072a32a', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369bb612-ed5c-4d21-9e89-d5b2fde0a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:17 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Volume volume-106d18f6-47ac-4f01-a59f-ccace072a32a (106d18f6-47ac-4f01-a59f-ccace072a32a): created successfully Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369bb612-ed5c-4d21-9e89-d5b2fde0a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Flow 'volume_create_manager' (409f3495-4c9c-4b23-810a-1f17a61d357a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f98e9143-3246-4bfa-8b68-116b0a6cacbc tempest-TestStampPattern-778790674 None] Created volume successfully. Jul 20 16:53:17 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.363s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Deleted volume successfully. Jul 20 16:53:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-59953b2c-f332-45e6-b7c7-39f5861adba7 tempest-VolumesCloneNegativeTest-1339057378 None] Lock "cinder-c4642c64-8c2d-43c0-8b6f-02ce11cce7c7-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=110,cinder:INSERT=39,cinder:UPDATE=141,cinder:DELETE=10 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Flow 'volume_create_manager' (352dd569-2e1b-4b70-a53f-11348712038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c74704-e5fb-485e-9cd8-d5277c96a209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c74704-e5fb-485e-9cd8-d5277c96a209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1154782391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0307b0a3-cc26-4306-bb36-e36f5dcf837f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abee3c236654d929ec6707083d10ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:22Z,use_quota=True,user_id='09554a1c0cd04756b17e904d83e61ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd89dcc-e1d6-45e3-a37f-e110cace71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd89dcc-e1d6-45e3-a37f-e110cace71b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f37158-1879-48e2-b96e-2c486f67e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f37158-1879-48e2-b96e-2c486f67e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0307b0a3-cc26-4306-bb36-e36f5dcf837f', 'volume_name': 'volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7684a95-2634-4415-b3e0-6fb4754f73d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7684a95-2634-4415-b3e0-6fb4754f73d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425913ea-425a-4d55-a561-eedf7e67feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Volume 0307b0a3-cc26-4306-bb36-e36f5dcf837f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f', 'volume_size': 1} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1154782391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0307b0a3-cc26-4306-bb36-e36f5dcf837f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abee3c236654d929ec6707083d10ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:22Z,use_quota=True,user_id='09554a1c0cd04756b17e904d83e61ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Creating volume 0307b0a3-cc26-4306-bb36-e36f5dcf837f {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:22 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:22 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f 1073741824 Jul 20 16:53:22 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:23 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f 1073741824" returned: 0 in 0.675s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:23 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f Jul 20 16:53:23 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:23 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f" returned: 0 in 0.564s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425913ea-425a-4d55-a561-eedf7e67feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d545a2c1-a3c5-440b-9601-be5c0bb6f5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:23 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Volume volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f (0307b0a3-cc26-4306-bb36-e36f5dcf837f): created successfully Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d545a2c1-a3c5-440b-9601-be5c0bb6f5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Flow 'volume_create_manager' (352dd569-2e1b-4b70-a53f-11348712038d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:23 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5320fcf3-8bbd-41e0-829c-ca26ac0a53db tempest-VolumesListTestJSON-822080790 None] Created volume successfully. Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Flow 'volume_create_manager' (962694ee-8ae3-47b5-8f6a-90cc4ced818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d5c65c-704e-4391-b70f-adcaa450f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d5c65c-704e-4391-b70f-adcaa450f384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827129635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad8ef89-681c-413f-8d89-0c499052f7f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abee3c236654d929ec6707083d10ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:25Z,use_quota=True,user_id='09554a1c0cd04756b17e904d83e61ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd07de8-551c-4638-abff-3b543897b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd07de8-551c-4638-abff-3b543897b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6e5dea-c315-437a-b105-7de0a6b8ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6e5dea-c315-437a-b105-7de0a6b8ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad8ef89-681c-413f-8d89-0c499052f7f9', 'volume_name': 'volume-0ad8ef89-681c-413f-8d89-0c499052f7f9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f017cdd-5635-4aa7-a0c5-5f6ee4941506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f017cdd-5635-4aa7-a0c5-5f6ee4941506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8214551-1d07-4135-a909-623521219f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:25 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Volume 0ad8ef89-681c-413f-8d89-0c499052f7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad8ef89-681c-413f-8d89-0c499052f7f9', 'volume_size': 1} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-827129635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad8ef89-681c-413f-8d89-0c499052f7f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abee3c236654d929ec6707083d10ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:25Z,use_quota=True,user_id='09554a1c0cd04756b17e904d83e61ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Creating volume 0ad8ef89-681c-413f-8d89-0c499052f7f9 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:25 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:25 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 1073741824 Jul 20 16:53:25 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:26 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 1073741824" returned: 0 in 0.692s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:26 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 Jul 20 16:53:26 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:26 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9" returned: 0 in 0.269s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8214551-1d07-4135-a909-623521219f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad8ef89-681c-413f-8d89-0c499052f7f9', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b595142-2b58-4e71-a4a0-c815b6888fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:26 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Volume volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 (0ad8ef89-681c-413f-8d89-0c499052f7f9): created successfully Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b595142-2b58-4e71-a4a0-c815b6888fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Flow 'volume_create_manager' (962694ee-8ae3-47b5-8f6a-90cc4ced818f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:26 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3fa22cf3-0dac-48ca-ab8d-b761b4e05508 tempest-VolumesListTestJSON-822080790 None] Created volume successfully. Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=115,cinder:UPDATE=128,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Flow 'volume_create_manager' (e3096c03-f7b6-42eb-b0e3-681fc6281fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be159ca6-9e9d-4b43-b08a-33c33c3c12d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be159ca6-9e9d-4b43-b08a-33c33c3c12d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-474166553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3c94e6-c5b1-4042-be08-b6d3965af22f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abee3c236654d929ec6707083d10ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:28Z,use_quota=True,user_id='09554a1c0cd04756b17e904d83e61ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5c00e7-51cb-4182-9e03-fc06d6fea805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5c00e7-51cb-4182-9e03-fc06d6fea805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a73558-9033-4477-97f6-4e6795611c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a73558-9033-4477-97f6-4e6795611c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3c94e6-c5b1-4042-be08-b6d3965af22f', 'volume_name': 'volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e3d4be-b8b1-4f68-8154-83c0f3d59fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e3d4be-b8b1-4f68-8154-83c0f3d59fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c5f122-2ac5-4325-bfd3-b5431d0a6335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Volume 0a3c94e6-c5b1-4042-be08-b6d3965af22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f', 'volume_size': 1} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-474166553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3c94e6-c5b1-4042-be08-b6d3965af22f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abee3c236654d929ec6707083d10ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:28Z,use_quota=True,user_id='09554a1c0cd04756b17e904d83e61ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Creating volume 0a3c94e6-c5b1-4042-be08-b6d3965af22f {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:28 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:28 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f 1073741824 Jul 20 16:53:28 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:28 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f 1073741824" returned: 0 in 0.706s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:29 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f Jul 20 16:53:29 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:29 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c5f122-2ac5-4325-bfd3-b5431d0a6335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158026dd-049f-44df-ace6-522146f69022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Volume volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f (0a3c94e6-c5b1-4042-be08-b6d3965af22f): created successfully Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158026dd-049f-44df-ace6-522146f69022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Flow 'volume_create_manager' (e3096c03-f7b6-42eb-b0e3-681fc6281fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5881c4ab-2323-43bc-afc9-298bd0906aa8 tempest-VolumesListTestJSON-822080790 None] Created volume successfully. Jul 20 16:53:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Acquiring lock "cinder-0a3c94e6-c5b1-4042-be08-b6d3965af22f-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Lock "cinder-0a3c94e6-c5b1-4042-be08-b6d3965af22f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Acquiring lock "cinder-quobyte-0a3c94e6-c5b1-4042-be08-b6d3965af22f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Lock "cinder-quobyte-0a3c94e6-c5b1-4042-be08-b6d3965af22f" acquired by "delete_volume" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:33 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa409c4-540f-41c2-9ecb-42d3b2ff0fc1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:33 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f Jul 20 16:53:33 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:34 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f" returned: 0 in 0.460s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:34 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f Jul 20 16:53:34 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:34 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0a3c94e6-c5b1-4042-be08-b6d3965af22f" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Lock "cinder-quobyte-0a3c94e6-c5b1-4042-be08-b6d3965af22f" released by "delete_volume" :: held 0.889s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Created reservations ['3bd97649-6361-4d34-bbd2-577e2e78bc54', 'a0776225-0cef-4e62-a09a-54660f6b5052', '6a3f19e4-3a53-49f3-81f7-b366d3ef617b', 'd6c45427-d6b8-4a46-a239-a7cb83495efd'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:34 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:34 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Acquiring lock "cinder-0ad8ef89-681c-413f-8d89-0c499052f7f9-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Lock "cinder-0ad8ef89-681c-413f-8d89-0c499052f7f9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Acquiring lock "cinder-quobyte-0ad8ef89-681c-413f-8d89-0c499052f7f9" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Lock "cinder-quobyte-0ad8ef89-681c-413f-8d89-0c499052f7f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8a94e8-2b6f-4f50-95fb-cd2d7c45f50f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:35 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.396s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Deleted volume successfully. Jul 20 16:53:35 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 Jul 20 16:53:35 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2e28f5fb-3c43-4078-8d40-cdce0709a27d tempest-VolumesListTestJSON-822080790 None] Lock "cinder-0a3c94e6-c5b1-4042-be08-b6d3965af22f-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:35 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9" returned: 0 in 0.396s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:35 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9 Jul 20 16:53:35 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:35 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0ad8ef89-681c-413f-8d89-0c499052f7f9" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Lock "cinder-quobyte-0ad8ef89-681c-413f-8d89-0c499052f7f9" released by "delete_volume" :: held 0.746s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Created reservations ['ea2f0d52-0b28-4a1e-8652-85d792a2b905', '579be2a8-b089-4864-83e0-f359a7d7fe2a', '6417eb12-90ee-49cf-8d67-c6cb9368512e', '4e52b0ac-7c07-45b1-93fd-4fd8cd5f4fe0'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:35 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:35 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "cinder-0307b0a3-cc26-4306-bb36-e36f5dcf837f-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Lock "cinder-0307b0a3-cc26-4306-bb36-e36f5dcf837f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:36 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.364s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Deleted volume successfully. Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "cinder-quobyte-0307b0a3-cc26-4306-bb36-e36f5dcf837f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Lock "cinder-quobyte-0307b0a3-cc26-4306-bb36-e36f5dcf837f" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2fe3715f-7483-4967-92a8-4e5712aacbbd tempest-VolumesListTestJSON-822080790 None] Lock "cinder-0ad8ef89-681c-413f-8d89-0c499052f7f9-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf2eda0-4478-4193-b2d9-90d05e06f843]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:36 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f Jul 20 16:53:36 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:36 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f" returned: 0 in 0.477s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:36 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f Jul 20 16:53:36 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:36 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-0307b0a3-cc26-4306-bb36-e36f5dcf837f" returned: 0 in 0.278s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Lock "cinder-quobyte-0307b0a3-cc26-4306-bb36-e36f5dcf837f" released by "delete_volume" :: held 0.803s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Created reservations ['27c79a20-8ced-4572-ab87-32fc24a15730', '4b4eab90-57ef-4428-9ba3-eb40144d9564', 'd863ec0d-6ec4-49a8-9232-bb244242f87d', '73bfbabf-eb1c-49c3-9d1b-da50289481de'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:37 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:37 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:37 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:37 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Deleted volume successfully. Jul 20 16:53:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0e2cb861-84d3-407e-adf9-983161906b07 tempest-VolumesListTestJSON-822080790 None] Lock "cinder-0307b0a3-cc26-4306-bb36-e36f5dcf837f-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:39 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:39 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:39 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:53:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Flow 'volume_create_manager' (19bd2273-29b7-4e05-ba00-a8b21995897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c8da96-a1e3-463e-9491-c4ca92c90975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c8da96-a1e3-463e-9491-c4ca92c90975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486d8744-b9d8-406b-851a-94f6d6be4fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370eed9f683d465285b27323d9347e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:44Z,use_quota=True,user_id='5e3031ab5c834234aa78f6633e180f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb95bc1-f23f-4d68-8821-5fe4a70fb308),volume_type_id=2cb95bc1-f23f-4d68-8821-5fe4a70fb308)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e430ca87-e30f-4afa-a7cd-ae3d9ea01324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e430ca87-e30f-4afa-a7cd-ae3d9ea01324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91faad7a-0cab-4393-a685-99ef36c9a7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:43 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91faad7a-0cab-4393-a685-99ef36c9a7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '486d8744-b9d8-406b-851a-94f6d6be4fa3', 'volume_name': 'volume-486d8744-b9d8-406b-851a-94f6d6be4fa3', 'volume_size': 1, 'image_id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a22c7c9b-a24f-40ec-973a-40b53dc38513', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be25d1d6ffe25819dc36a73df987d9e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '370eed9f683d465285b27323d9347e2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6fd294d943cbfe5a56c9ed5c7b7f302a810c055ee62628de42113bbb1d067ed53dbf9de80c6a291cf9ab5e2fd9d1c97557c3d91a943c1349ce184e53bec7b64', 'id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'created_at': datetime.datetime(2026, 7, 20, 14, 53, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a22c7c9b-a24f-40ec-973a-40b53dc38513/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea545e9-4b13-4a76-b77c-77c2988a47f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea545e9-4b13-4a76-b77c-77c2988a47f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c40df7-2fd9-49b7-b014-5b600f14deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:44 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Volume 486d8744-b9d8-406b-851a-94f6d6be4fa3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-486d8744-b9d8-406b-851a-94f6d6be4fa3', 'volume_size': 1, 'image_id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a22c7c9b-a24f-40ec-973a-40b53dc38513', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be25d1d6ffe25819dc36a73df987d9e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '370eed9f683d465285b27323d9347e2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6fd294d943cbfe5a56c9ed5c7b7f302a810c055ee62628de42113bbb1d067ed53dbf9de80c6a291cf9ab5e2fd9d1c97557c3d91a943c1349ce184e53bec7b64', 'id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'created_at': datetime.datetime(2026, 7, 20, 14, 53, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a22c7c9b-a24f-40ec-973a-40b53dc38513/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Trying to clone 486d8744-b9d8-406b-851a-94f6d6be4fa3 from image a22c7c9b-a24f-40ec-973a-40b53dc38513 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a22c7c9b-a24f-40ec-973a-40b53dc38513', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:53:44 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Image download 0.00 MB at 0.00 MB/s Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69a7d0-37dc-4b34-9124-10d14817d54a]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:44 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD Jul 20 16:53:44 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:44 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:44 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD Jul 20 16:53:44 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:45 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD" returned: 1 in 0.384s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Temporary image a22c7c9b-a24f-40ec-973a-40b53dc38513 is fetched for user 5e3031ab5c834234aa78f6633e180f8f. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5ef761-8471-4d8b-9237-2093fc516c1b]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:45 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD Jul 20 16:53:45 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:45 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:45 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD Jul 20 16:53:45 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:45 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486d8744-b9d8-406b-851a-94f6d6be4fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370eed9f683d465285b27323d9347e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:44Z,use_quota=True,user_id='5e3031ab5c834234aa78f6633e180f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cb95bc1-f23f-4d68-8821-5fe4a70fb308),volume_type_id=2cb95bc1-f23f-4d68-8821-5fe4a70fb308)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Creating volume 486d8744-b9d8-406b-851a-94f6d6be4fa3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:45 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:45 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 1073741824 Jul 20 16:53:45 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:46 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 1073741824" returned: 0 in 0.472s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:46 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 Jul 20 16:53:46 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:46 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Attempting download of a22c7c9b-a24f-40ec-973a-40b53dc38513 ((None, [{'url': 'file:///opt/stack/data/glance/images/a22c7c9b-a24f-40ec-973a-40b53dc38513', 'metadata': {}}])) to volume 486d8744-b9d8-406b-851a-94f6d6be4fa3. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ce48a-afe4-4a7b-928f-596cf9c77bb2]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_ {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:46 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_ Jul 20 16:53:46 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:47 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_" returned: 0 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_ {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:47 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_ Jul 20 16:53:47 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:47 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_" returned: 1 in 0.374s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a22c7c9b-a24f-40ec-973a-40b53dc38513_0_dyixk_' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd67f74-4f07-4129-8322-cbb9852d5a9d]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:47 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD Jul 20 16:53:47 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:47 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:48 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD Jul 20 16:53:48 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:48 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] a22c7c9b-a24f-40ec-973a-40b53dc38513 was raw, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:48 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 Jul 20 16:53:48 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-2a43d222-289b-4619-b60d-05d5a9f3309b req-900eae75-6d99-4cab-888f-c3adeba2ecf0 tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-2a43d222-289b-4619-b60d-05d5a9f3309b req-900eae75-6d99-4cab-888f-c3adeba2ecf0 tempest-TestStampPattern-778790674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-2a43d222-289b-4619-b60d-05d5a9f3309b req-900eae75-6d99-4cab-888f-c3adeba2ecf0 tempest-TestStampPattern-778790674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-2a43d222-289b-4619-b60d-05d5a9f3309b req-900eae75-6d99-4cab-888f-c3adeba2ecf0 tempest-TestStampPattern-778790674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-106d18f6-47ac-4f01-a59f-ccace072a32a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40b2f986-0cb3-4deb-a735-8fb0389c056e', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:53:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-2a43d222-289b-4619-b60d-05d5a9f3309b req-900eae75-6d99-4cab-888f-c3adeba2ecf0 tempest-TestStampPattern-778790674 None] attachment_update completed successfully. Jul 20 16:53:48 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3" returned: 0 in 0.663s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a22c7c9b-a24f-40ec-973a-40b53dc38513_fai8a277devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:53:48 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Converted 0.00 MB image at 0.00 MB/s Jul 20 16:53:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:49 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 1G Jul 20 16:53:49 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:49 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 1G" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Downloaded image a22c7c9b-a24f-40ec-973a-40b53dc38513 ((None, [{'url': 'file:///opt/stack/data/glance/images/a22c7c9b-a24f-40ec-973a-40b53dc38513', 'metadata': {}}])) to volume 486d8744-b9d8-406b-851a-94f6d6be4fa3 successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Temporary image a22c7c9b-a24f-40ec-973a-40b53dc38513 for user 5e3031ab5c834234aa78f6633e180f8f is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Marking volume 486d8744-b9d8-406b-851a-94f6d6be4fa3 as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Copying metadata from image a22c7c9b-a24f-40ec-973a-40b53dc38513 to 486d8744-b9d8-406b-851a-94f6d6be4fa3. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Creating volume glance metadata for volume 486d8744-b9d8-406b-851a-94f6d6be4fa3 backed by image a22c7c9b-a24f-40ec-973a-40b53dc38513 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'be25d1d6ffe25819dc36a73df987d9e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c40df7-2fd9-49b7-b014-5b600f14deb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486d8744-b9d8-406b-851a-94f6d6be4fa3', 'volume_size': 1, 'image_id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a22c7c9b-a24f-40ec-973a-40b53dc38513', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'be25d1d6ffe25819dc36a73df987d9e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '370eed9f683d465285b27323d9347e2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6fd294d943cbfe5a56c9ed5c7b7f302a810c055ee62628de42113bbb1d067ed53dbf9de80c6a291cf9ab5e2fd9d1c97557c3d91a943c1349ce184e53bec7b64', 'id': 'a22c7c9b-a24f-40ec-973a-40b53dc38513', 'created_at': datetime.datetime(2026, 7, 20, 14, 53, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 53, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a22c7c9b-a24f-40ec-973a-40b53dc38513/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3681b121-1552-40f9-af05-585abc8ccac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:49 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Volume volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 (486d8744-b9d8-406b-851a-94f6d6be4fa3): created successfully Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3681b121-1552-40f9-af05-585abc8ccac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:49 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Flow 'volume_create_manager' (19bd2273-29b7-4e05-ba00-a8b21995897f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:49 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-417a7010-5042-4929-840a-34c753ed7c75 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Created volume successfully. Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Acquiring lock "cinder-486d8744-b9d8-406b-851a-94f6d6be4fa3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "cinder-486d8744-b9d8-406b-851a-94f6d6be4fa3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Acquiring lock "cinder-quobyte-486d8744-b9d8-406b-851a-94f6d6be4fa3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "cinder-quobyte-486d8744-b9d8-406b-851a-94f6d6be4fa3" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b194e9d5-e4e0-4757-b4e5-dc21f0c09e65]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:50 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 Jul 20 16:53:50 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:50 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:50 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3 Jul 20 16:53:50 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:50 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-486d8744-b9d8-406b-851a-94f6d6be4fa3" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "cinder-quobyte-486d8744-b9d8-406b-851a-94f6d6be4fa3" released by "delete_volume" :: held 0.722s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:50 devstack cinder-volume[87535]: WARNING cinder.quota [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:53:50 devstack cinder-volume[87535]: WARNING cinder.quota [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 20 16:53:50 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Created reservations ['c2160a8f-b99e-4856-abe3-26420939ccf1', '17ff5a06-baf6-4c88-9ec9-48382c5a2e3e', '0f49b842-d929-43a6-825f-4d0c41341b79', 'fa80a016-ab86-4dc2-9999-50139788944d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:51 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:53:51 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:51 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:53:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Deleted volume successfully. Jul 20 16:53:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-45d2f7ac-fb30-47be-b1f4-c27771e3b648 tempest-VolumeAndVolumeTypeFromImageTest-2114483055 None] Lock "cinder-486d8744-b9d8-406b-851a-94f6d6be4fa3-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:53:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-6b34b028-f21f-469a-a023-c904821bc475 req-955758be-c729-4895-8125-c95b46d943ab tempest-TestStampPattern-778790674 None] Terminate volume connection completed successfully. Jul 20 16:53:55 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-6b34b028-f21f-469a-a023-c904821bc475 req-955758be-c729-4895-8125-c95b46d943ab tempest-TestStampPattern-778790674 None] Deleting attachment 40b2f986-0cb3-4deb-a735-8fb0389c056e. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Creating offline snapshot 72435b74-0f6e-470f-a33e-6e94ab09d83f of volume 106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4544db5b-bf61-4d97-8dee-3f04d51f8064]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:56 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:53:56 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:56 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.685s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:56 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f 1G Jul 20 16:53:56 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:57 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f 1G" returned: 0 in 0.771s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106d18f6-47ac-4f01-a59f-ccace072a32a -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:57 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106d18f6-47ac-4f01-a59f-ccace072a32a -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f Jul 20 16:53:57 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:58 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106d18f6-47ac-4f01-a59f-ccace072a32a -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:58 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f is being set with open permissions: ugo+rw Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:58 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f Jul 20 16:53:58 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (425dec5a-938d-49ab-b26f-5eb6d7bb1da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d735a0f6-6597-4f89-bd76-1e05e72dbe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d735a0f6-6597-4f89-bd76-1e05e72dbe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603339689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96de7b6-9f9e-4c4e-adcf-1db954ff28ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:58Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957f61b6-a81d-4de5-b94f-81076d709b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957f61b6-a81d-4de5-b94f-81076d709b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14444434-720f-4199-b50c-cac0c97bc641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14444434-720f-4199-b50c-cac0c97bc641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96de7b6-9f9e-4c4e-adcf-1db954ff28ba', 'volume_name': 'volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6af492-867d-4fed-85e0-9bd4d8e29cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6af492-867d-4fed-85e0-9bd4d8e29cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169c9ec3-75ef-4a24-a0ea-05ed49f48b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:58 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume a96de7b6-9f9e-4c4e-adcf-1db954ff28ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba', 'volume_size': 1} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:58 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f" returned: 0 in 0.325s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:58 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info Jul 20 16:53:58 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:58 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info" returned: 0 in 0.251s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:58 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info is being set with open permissions: ugo+rw Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:58 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info Jul 20 16:53:58 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:58 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.info" returned: 0 in 0.242s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-603339689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96de7b6-9f9e-4c4e-adcf-1db954ff28ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:53:58Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating volume a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:53:58 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:53:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:58 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba 1073741824 Jul 20 16:53:58 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:58 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d47bb7de-c2bf-4394-b079-3bf6e5c72a30 tempest-TestStampPattern-778790674 None] Create snapshot completed successfully Jul 20 16:53:59 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba 1073741824" returned: 0 in 0.479s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:53:59 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba Jul 20 16:53:59 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:53:59 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" returned: 0 in 0.313s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169c9ec3-75ef-4a24-a0ea-05ed49f48b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b4922c-c6e3-4b60-a65a-d6229f332a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:53:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba (a96de7b6-9f9e-4c4e-adcf-1db954ff28ba): created successfully Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b4922c-c6e3-4b60-a65a-d6229f332a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:53:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (425dec5a-938d-49ab-b26f-5eb6d7bb1da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:53:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-13477c97-3df1-4766-8d50-c6884507fa76 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created volume successfully. Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating offline snapshot 6f3a853d-bb74-415e-8f37-bc642779bbff of volume a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6d369-7720-4d1c-9ab2-a9c801a23b97]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:00 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba Jul 20 16:54:00 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:00 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" returned: 0 in 0.409s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:00 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff 1G Jul 20 16:54:00 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:01 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff 1G" returned: 0 in 0.424s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:01 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff Jul 20 16:54:01 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:01 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff" returned: 0 in 0.328s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:01 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff is being set with open permissions: ugo+rw Jul 20 16:54:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:01 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff Jul 20 16:54:01 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:01 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:01 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info Jul 20 16:54:01 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:02 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info" returned: 0 in 0.273s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:02 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info is being set with open permissions: ugo+rw Jul 20 16:54:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:02 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info Jul 20 16:54:02 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:02 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.info" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-53e732c5-752f-4eb3-83fd-a6c61d516dc7 tempest-CreateVolumesFromSnapshotTest-40517512 None] Create snapshot completed successfully Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (9a710730-da70-475d-82ff-5bf4ee006dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d928ebf-55a9-4413-84e6-dc0e10238c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d928ebf-55a9-4413-84e6-dc0e10238c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199084195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dc7859-ac9a-4904-ab69-4e8d72c9c589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:04Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f22546-b150-4d14-8ef4-6f884499a296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f22546-b150-4d14-8ef4-6f884499a296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7c9c0f-629d-488e-9419-0ae628b3f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7c9c0f-629d-488e-9419-0ae628b3f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49dc7859-ac9a-4904-ab69-4e8d72c9c589', 'volume_name': 'volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38132755-d150-452e-ac6f-f9a634e568fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38132755-d150-452e-ac6f-f9a634e568fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48bca1e-3428-4846-a729-2f582b4e1e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume 49dc7859-ac9a-4904-ab69-4e8d72c9c589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589', 'volume_size': 1} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199084195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dc7859-ac9a-4904-ab69-4e8d72c9c589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:04Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating volume 49dc7859-ac9a-4904-ab69-4e8d72c9c589 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:04 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:04 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 1073741824 Jul 20 16:54:04 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (aaf7c4ce-3d67-4a4d-8c3d-8c98b36d21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c8cf4c-edfe-46ed-bae8-3f5739ad95b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c8cf4c-edfe-46ed-bae8-3f5739ad95b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181022356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6c9477-e226-4ab7-b5c3-982603ba4f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:05Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a4ad0-3c45-4c2e-86da-061c93248bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843a4ad0-3c45-4c2e-86da-061c93248bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2cb138-219f-424f-9787-f7af309b3e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2cb138-219f-424f-9787-f7af309b3e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6c9477-e226-4ab7-b5c3-982603ba4f29', 'volume_name': 'volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9a142f-fd8c-4cf4-aec5-f99131ec99b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9a142f-fd8c-4cf4-aec5-f99131ec99b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca79da09-d508-4389-b406-f7bf8ed4e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:04 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume 2c6c9477-e226-4ab7-b5c3-982603ba4f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29', 'volume_size': 1} Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:04 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 1073741824" returned: 0 in 0.682s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:05 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 Jul 20 16:54:05 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (c41f253c-5dcb-4510-bb63-bbacab17b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d938c5-42a2-4b80-a2f6-60b7b633bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d938c5-42a2-4b80-a2f6-60b7b633bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1786286045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfce451-8b91-4547-80e4-e581cefaabe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:05Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916a50f4-a242-4ef1-b47c-a41fa506eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (916a50f4-a242-4ef1-b47c-a41fa506eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c450069f-c052-452e-bb5f-8efc1c674c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c450069f-c052-452e-bb5f-8efc1c674c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfce451-8b91-4547-80e4-e581cefaabe1', 'volume_name': 'volume-4cfce451-8b91-4547-80e4-e581cefaabe1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082e8c90-0d16-4d1c-8767-9c0efb2908f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082e8c90-0d16-4d1c-8767-9c0efb2908f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa06b80-e277-4f60-9106-0710aec98887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume 4cfce451-8b91-4547-80e4-e581cefaabe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfce451-8b91-4547-80e4-e581cefaabe1', 'volume_size': 1} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:05 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589" returned: 0 in 0.580s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181022356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6c9477-e226-4ab7-b5c3-982603ba4f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:05Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating volume 2c6c9477-e226-4ab7-b5c3-982603ba4f29 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:05 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:05 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 1073741824 Jul 20 16:54:05 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48bca1e-3428-4846-a729-2f582b4e1e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa23f35-b1c2-4395-a33e-818f2139967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 (49dc7859-ac9a-4904-ab69-4e8d72c9c589): created successfully Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa23f35-b1c2-4395-a33e-818f2139967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (9a710730-da70-475d-82ff-5bf4ee006dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-00b5b9f0-d1d3-468f-a687-9401619e63b1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created volume successfully. Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (172e82ea-497b-4fd5-b43b-caa29872db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974280cd-4d87-4cf4-9b69-92af78b1a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974280cd-4d87-4cf4-9b69-92af78b1a06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-776780723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d32086-fb54-4c9e-903d-8ca429d69b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:06Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d89f7b-5928-490e-bf63-fe710d78d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d89f7b-5928-490e-bf63-fe710d78d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b8e98c-3967-4957-8519-d73736cf5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b8e98c-3967-4957-8519-d73736cf5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d32086-fb54-4c9e-903d-8ca429d69b26', 'volume_name': 'volume-82d32086-fb54-4c9e-903d-8ca429d69b26', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee8397-f637-4fa0-b51c-4a56b1c9602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ee8397-f637-4fa0-b51c-4a56b1c9602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2209ddd-29e3-4af6-9099-81294e53bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume 82d32086-fb54-4c9e-903d-8ca429d69b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d32086-fb54-4c9e-903d-8ca429d69b26', 'volume_size': 1} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:06 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 1073741824" returned: 0 in 0.671s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:06 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 Jul 20 16:54:06 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (60cf8e13-6d7b-4c4a-bf61-7bdfd10b06ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eddc57-b6c7-462e-87f5-d21a68ea6311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eddc57-b6c7-462e-87f5-d21a68ea6311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137864722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251c4f4b-cc7a-4733-9a85-a7be3ad3ce86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:06Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e3efe5-7fa7-44fe-a833-fa8cc460c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e3efe5-7fa7-44fe-a833-fa8cc460c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e30782-19e6-4d8a-b7e3-d0d976126475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e30782-19e6-4d8a-b7e3-d0d976126475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251c4f4b-cc7a-4733-9a85-a7be3ad3ce86', 'volume_name': 'volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b087bbff-bc29-43cd-b74b-df83ef545b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b087bbff-bc29-43cd-b74b-df83ef545b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2d31fe-ae61-4070-ad35-c38f3ee7e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume 251c4f4b-cc7a-4733-9a85-a7be3ad3ce86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86', 'volume_size': 1} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:06 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29" returned: 0 in 0.306s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1786286045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfce451-8b91-4547-80e4-e581cefaabe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:05Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating volume 4cfce451-8b91-4547-80e4-e581cefaabe1 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:06 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca79da09-d508-4389-b406-f7bf8ed4e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40a75f5-3133-47e4-934a-4a396cc3ec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:06 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 1073741824 Jul 20 16:54:06 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 (2c6c9477-e226-4ab7-b5c3-982603ba4f29): created successfully Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40a75f5-3133-47e4-934a-4a396cc3ec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (aaf7c4ce-3d67-4a4d-8c3d-8c98b36d21cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c69a739f-4e7d-4c29-b5cb-032af67b7268 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created volume successfully. Jul 20 16:54:07 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 1073741824" returned: 0 in 0.461s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:07 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 Jul 20 16:54:07 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Flow 'volume_create_manager' (6e1e6531-2870-41e8-9beb-48f015187a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b761e-018e-4098-8b9a-3df94a525308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123b761e-018e-4098-8b9a-3df94a525308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1118324466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62d9475-53f9-4e51-8f19-800d0977cbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51a69da93c34935b4846140b2c8345b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72435b74-0f6e-470f-a33e-6e94ab09d83f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:07Z,use_quota=True,user_id='c4034241dbf54457af84c78afbce8114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627a4d44-4e25-4360-ac06-bd52f708963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (627a4d44-4e25-4360-ac06-bd52f708963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617a2261-3bb8-49da-ba81-130916824a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617a2261-3bb8-49da-ba81-130916824a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f62d9475-53f9-4e51-8f19-800d0977cbe7', 'volume_name': 'volume-f62d9475-53f9-4e51-8f19-800d0977cbe7', 'volume_size': 1, 'snapshot_id': '72435b74-0f6e-470f-a33e-6e94ab09d83f'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c79a37b-76b8-49b0-ac36-1301c7b7ab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c79a37b-76b8-49b0-ac36-1301c7b7ab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e32046-723c-4b3c-b30c-156464c6eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Volume f62d9475-53f9-4e51-8f19-800d0977cbe7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f62d9475-53f9-4e51-8f19-800d0977cbe7', 'volume_size': 1, 'snapshot_id': '72435b74-0f6e-470f-a33e-6e94ab09d83f'} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:07 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-776780723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d32086-fb54-4c9e-903d-8ca429d69b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:06Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating volume 82d32086-fb54-4c9e-903d-8ca429d69b26 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:07 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:07 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 1073741824 Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa06b80-e277-4f60-9106-0710aec98887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfce451-8b91-4547-80e4-e581cefaabe1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:07 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d7e80-5add-4e34-95da-5c6df47c8df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume volume-4cfce451-8b91-4547-80e4-e581cefaabe1 (4cfce451-8b91-4547-80e4-e581cefaabe1): created successfully Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d7e80-5add-4e34-95da-5c6df47c8df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (c41f253c-5dcb-4510-bb63-bbacab17b892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f14685e7-0f84-4a2a-b65e-876c22533041 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created volume successfully. Jul 20 16:54:07 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 1073741824" returned: 0 in 0.480s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:08 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 Jul 20 16:54:08 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:08 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26" returned: 0 in 0.266s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.657s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137864722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251c4f4b-cc7a-4733-9a85-a7be3ad3ce86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a84f9de73f4af9a2602e078f3c3c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:06Z,use_quota=True,user_id='52f050781c4d4c40b17b656e7c791055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Creating volume 251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:08 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2209ddd-29e3-4af6-9099-81294e53bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d32086-fb54-4c9e-903d-8ca429d69b26', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:08 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 1073741824 Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefee0db-5f6a-4971-be57-ec66d7884e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:08 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:08 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume volume-82d32086-fb54-4c9e-903d-8ca429d69b26 (82d32086-fb54-4c9e-903d-8ca429d69b26): created successfully Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefee0db-5f6a-4971-be57-ec66d7884e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (172e82ea-497b-4fd5-b43b-caa29872db80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8c87ae63-643c-4f7b-8a4b-d1e09d1462ce tempest-CreateVolumesFromSnapshotTest-40517512 None] Created volume successfully. Jul 20 16:54:08 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 1073741824" returned: 0 in 0.485s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:08 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 Jul 20 16:54:08 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:09 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.741s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-quobyte-72435b74-0f6e-470f-a33e-6e94ab09d83f-f62d9475-53f9-4e51-8f19-800d0977cbe7" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2d31fe-ae61-4070-ad35-c38f3ee7e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5aac408-1786-4aa9-8a47-8391d24d5ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-72435b74-0f6e-470f-a33e-6e94ab09d83f-f62d9475-53f9-4e51-8f19-800d0977cbe7" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Creating volume f62d9475-53f9-4e51-8f19-800d0977cbe7 from snapshot 72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-quobyte-f62d9475-53f9-4e51-8f19-800d0977cbe7" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Volume volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 (251c4f4b-cc7a-4733-9a85-a7be3ad3ce86): created successfully Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5aac408-1786-4aa9-8a47-8391d24d5ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Flow 'volume_create_manager' (60cf8e13-6d7b-4c4a-bf61-7bdfd10b06ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-f62d9475-53f9-4e51-8f19-800d0977cbe7" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] snapshot: 72435b74-0f6e-470f-a33e-6e94ab09d83f, volume: f62d9475-53f9-4e51-8f19-800d0977cbe7, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:54:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0d45396e-8113-493a-8876-1d116c90282a tempest-CreateVolumesFromSnapshotTest-40517512 None] Created volume successfully. Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d8d68-cd34-4b00-8a01-16f07652cb5c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:09 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f Jul 20 16:54:09 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:09 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f" returned: 0 in 0.443s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106d18f6-47ac-4f01-a59f-ccace072a32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732dafa-37a7-48ea-ab9c-13a456c2737b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:09 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:54:09 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86" acquired by "delete_volume" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de54be-c517-4406-981e-a366a5bd4434]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:10 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.704s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:10 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 Jul 20 16:54:10 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:10 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 Jul 20 16:54:10 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:10 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86" returned: 0 in 0.652s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:10 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86 Jul 20 16:54:10 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:11 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86" returned: 0 in 0.545s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86" released by "delete_volume" :: held 1.292s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['69dfc4b4-3753-4d1c-a6f7-a667bbe9b850', '2d58922d-2d45-4cb4-a099-ae1153a0874f', 'e188de06-2b5f-4611-9da0-65b83e577152', '672085c7-a40e-4d56-81f5-ffb3dce984a3'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:11 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:11 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:12 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.454s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleted volume successfully. Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c9ed5467-636f-4f98-9597-2fbe076d9709 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-251c4f4b-cc7a-4733-9a85-a7be3ad3ce86-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-82d32086-fb54-4c9e-903d-8ca429d69b26-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-82d32086-fb54-4c9e-903d-8ca429d69b26-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-82d32086-fb54-4c9e-903d-8ca429d69b26" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-82d32086-fb54-4c9e-903d-8ca429d69b26" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[36303de6-7946-4e2f-ab6d-786593a079be]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:12 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 Jul 20 16:54:12 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:13 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26" returned: 0 in 1.021s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:13 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26 Jul 20 16:54:13 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:14 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-82d32086-fb54-4c9e-903d-8ca429d69b26" returned: 0 in 0.499s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-82d32086-fb54-4c9e-903d-8ca429d69b26" released by "delete_volume" :: held 1.632s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['bf8f8aea-c17d-4483-90a7-8df7a9f4558a', 'd43dbd40-de1a-4842-b935-fcad09f50e7e', '4e0ddceb-6ade-489c-9026-4b84f082e1c9', '0bfb8e7e-d95a-4d94-9d55-2d1641333bdb'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:14 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:14 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-4cfce451-8b91-4547-80e4-e581cefaabe1-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-4cfce451-8b91-4547-80e4-e581cefaabe1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-4cfce451-8b91-4547-80e4-e581cefaabe1" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-4cfce451-8b91-4547-80e4-e581cefaabe1" acquired by "delete_volume" :: waited 0.068s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:15 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.818s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb4aa4-5de6-40e4-a933-e862640d3ac2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleted volume successfully. Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b8338fe5-29b9-4b33-a516-945ec62d2b3f tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-82d32086-fb54-4c9e-903d-8ca429d69b26-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:15 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 Jul 20 16:54:15 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:16 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1" returned: 0 in 1.366s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:17 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1 Jul 20 16:54:17 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:17 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7" returned: 0 in 7.077s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7a486-68d5-490e-819c-d2b30bd40b88]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:17 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4cfce451-8b91-4547-80e4-e581cefaabe1" returned: 0 in 0.738s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-4cfce451-8b91-4547-80e4-e581cefaabe1" released by "delete_volume" :: held 2.292s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:17 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:54:17 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['6e8366fc-812b-4b69-b136-f5b05fd408a9', '4a71ca0a-d96c-4081-a215-2143ccc03206', 'ae051f65-0b04-4533-8ba3-a18f895f3a0e', 'af1eb0ce-4b65-4e75-8852-50ec60eef19f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:17 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:17 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:18 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.541s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleted volume successfully. Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c0fcc03f-0257-4572-a86a-8db1f44c981e tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-4cfce451-8b91-4547-80e4-e581cefaabe1-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:18 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.996s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:54:18 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Converted 1024.00 MB image at 144.68 MB/s Jul 20 16:54:18 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 is being set with open permissions: ugo+rw Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:18 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 Jul 20 16:54:18 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:18 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7" returned: 0 in 0.265s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-f62d9475-53f9-4e51-8f19-800d0977cbe7" released by "_copy_volume_from_snapshot" :: held 9.631s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-72435b74-0f6e-470f-a33e-6e94ab09d83f-f62d9475-53f9-4e51-8f19-800d0977cbe7" released by "_create_volume_from_snapshot" :: held 9.682s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.720s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-2c6c9477-e226-4ab7-b5c3-982603ba4f29-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e32046-723c-4b3c-b30c-156464c6eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62d9475-53f9-4e51-8f19-800d0977cbe7', 'volume_size': 1, 'snapshot_id': '72435b74-0f6e-470f-a33e-6e94ab09d83f'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe64bfe4-a1cf-46b5-8333-4e21235cd4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-2c6c9477-e226-4ab7-b5c3-982603ba4f29-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:18 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Volume volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 (f62d9475-53f9-4e51-8f19-800d0977cbe7): created successfully Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe64bfe4-a1cf-46b5-8333-4e21235cd4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Flow 'volume_create_manager' (6e1e6531-2870-41e8-9beb-48f015187a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-2c6c9477-e226-4ab7-b5c3-982603ba4f29" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-2c6c9477-e226-4ab7-b5c3-982603ba4f29" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f939e211-24d2-4e35-b52e-2704756a5533 tempest-TestStampPattern-778790674 None] Created volume successfully. Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b65809-112e-4f40-8b83-544df25498ee]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:19 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 Jul 20 16:54:19 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:19 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29" returned: 0 in 0.412s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:19 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29 Jul 20 16:54:19 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:19 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2c6c9477-e226-4ab7-b5c3-982603ba4f29" returned: 0 in 0.289s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-2c6c9477-e226-4ab7-b5c3-982603ba4f29" released by "delete_volume" :: held 0.756s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['a8d687a5-4a01-45b6-92b9-f70f7bbdb192', 'ff2005ef-5e78-4edf-a6c2-b75bd34a2d22', 'a9ba467a-bb8b-4edb-ad4b-8517e0813341', '610de914-4ed1-4a81-9618-8f7b63bae160'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:19 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:19 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-49dc7859-ac9a-4904-ab69-4e8d72c9c589-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-49dc7859-ac9a-4904-ab69-4e8d72c9c589-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-49dc7859-ac9a-4904-ab69-4e8d72c9c589" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-49dc7859-ac9a-4904-ab69-4e8d72c9c589" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:20 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleted volume successfully. Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa7f40-12b1-401d-ab58-f08ae09cdb3e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cc966f90-51d3-4064-af0a-6b29a338f71d tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-2c6c9477-e226-4ab7-b5c3-982603ba4f29-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:20 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 Jul 20 16:54:20 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:20 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589" returned: 0 in 0.479s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:20 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589 Jul 20 16:54:20 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:21 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-49dc7859-ac9a-4904-ab69-4e8d72c9c589" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-49dc7859-ac9a-4904-ab69-4e8d72c9c589" released by "delete_volume" :: held 0.905s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['1567cf0c-ed55-4bd2-9eb7-26e871e36f57', '5aa36cde-6b3b-4213-be07-18ad6b0bb45b', '3a48e1f6-eab1-4b60-b689-fb78fec643cf', '71c1e191-9ec5-4a1d-8cdb-39e36b712002'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Flow 'volume_create_manager' (9a190b70-ac9b-45bd-a6f8-6cb69c3c81dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca0e7f3-6da1-487f-8ad6-e434c9e82c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:21 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:21 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca0e7f3-6da1-487f-8ad6-e434c9e82c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-556303182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de791c7e-8c45-44b3-8c7c-44d4626e644d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3f47305b14377964daba19448315e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:21Z,use_quota=True,user_id='3f190b606bc3447a903c1d449f5e5379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4981c9f-7b41-44b2-b197-0c8bd3718784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4981c9f-7b41-44b2-b197-0c8bd3718784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feadc13-bf37-4751-8e5e-0246e0d8c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feadc13-bf37-4751-8e5e-0246e0d8c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de791c7e-8c45-44b3-8c7c-44d4626e644d', 'volume_name': 'volume-de791c7e-8c45-44b3-8c7c-44d4626e644d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eece3831-876d-4d46-be05-db106aa597d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eece3831-876d-4d46-be05-db106aa597d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac02f4e-df9e-4538-8d76-0837cc9bad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Volume de791c7e-8c45-44b3-8c7c-44d4626e644d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de791c7e-8c45-44b3-8c7c-44d4626e644d', 'volume_size': 1} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-556303182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de791c7e-8c45-44b3-8c7c-44d4626e644d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3f47305b14377964daba19448315e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:21Z,use_quota=True,user_id='3f190b606bc3447a903c1d449f5e5379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Creating volume de791c7e-8c45-44b3-8c7c-44d4626e644d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:21 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:21 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d 1073741824 Jul 20 16:54:21 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:21 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleted volume successfully. Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c8198b75-82d0-414f-a9cb-7b8bf0a9fef1 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-49dc7859-ac9a-4904-ab69-4e8d72c9c589-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:21 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d 1073741824" returned: 0 in 0.479s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:22 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d Jul 20 16:54:22 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:22 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d" returned: 0 in 0.265s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac02f4e-df9e-4538-8d76-0837cc9bad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de791c7e-8c45-44b3-8c7c-44d4626e644d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502a34d8-6837-4b7a-85f8-858ed004f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Volume volume-de791c7e-8c45-44b3-8c7c-44d4626e644d (de791c7e-8c45-44b3-8c7c-44d4626e644d): created successfully Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502a34d8-6837-4b7a-85f8-858ed004f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Flow 'volume_create_manager' (9a190b70-ac9b-45bd-a6f8-6cb69c3c81dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-22876e47-fb00-4d75-97c4-935d9d0dc959 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Created volume successfully. Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-6f3a853d-bb74-415e-8f37-bc642779bbff-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-6f3a853d-bb74-415e-8f37-bc642779bbff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-6f3a853d-bb74-415e-8f37-bc642779bbff" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-6f3a853d-bb74-415e-8f37-bc642779bbff" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleting offline snapshot 6f3a853d-bb74-415e-8f37-bc642779bbff of volume a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] snapshot_file for this snap is: volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279e2e5-b84c-478f-ba93-07525aedf289]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:22 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff Jul 20 16:54:22 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:22 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff" returned: 0 in 0.380s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadcf071-bf29-48b8-a1c8-261f736b2db2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:23 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba Jul 20 16:54:23 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:23 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:23 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff Jul 20 16:54:23 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:23 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff" returned: 0 in 0.376s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:23 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff Jul 20 16:54:23 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:24 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba.6f3a853d-bb74-415e-8f37-bc642779bbff" returned: 0 in 0.323s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=130,cinder:SELECT=86,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-6f3a853d-bb74-415e-8f37-bc642779bbff" released by "_delete_snapshot" :: held 1.587s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" released by "delete_snapshot" :: held 1.614s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['700ff51f-09e0-4fa6-a35c-a524462993b5', '3d136da3-6d3b-4b06-bee3-3ba11a690e57', '42bc8e56-89ac-4292-9a02-045e08280f84', '62d7e818-020c-4ef7-a53a-1a251aee8ac9'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-32faf4f8-5f9b-4781-95eb-d4b2c77d1853 req-4abcfb35-dea9-41fd-a71a-b355d90d6363 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-32faf4f8-5f9b-4781-95eb-d4b2c77d1853 req-4abcfb35-dea9-41fd-a71a-b355d90d6363 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-32faf4f8-5f9b-4781-95eb-d4b2c77d1853 req-4abcfb35-dea9-41fd-a71a-b355d90d6363 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-32faf4f8-5f9b-4781-95eb-d4b2c77d1853 req-4abcfb35-dea9-41fd-a71a-b355d90d6363 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-de791c7e-8c45-44b3-8c7c-44d4626e644d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fdedd88-df29-4b14-9982-f2ede83aff7c', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:54:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Delete snapshot completed successfully. Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7211386a-035f-4f4d-b31d-e682d20e9fd5 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-6f3a853d-bb74-415e-8f37-bc642779bbff-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-32faf4f8-5f9b-4781-95eb-d4b2c77d1853 req-4abcfb35-dea9-41fd-a71a-b355d90d6363 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] attachment_update completed successfully. Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "cinder-quobyte-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dd9c84-90d8-4c86-a3c7-105f1fe04d55]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:24 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba Jul 20 16:54:24 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:25 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" returned: 0 in 0.469s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:25 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba Jul 20 16:54:25 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:25 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-quobyte-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba" released by "delete_volume" :: held 0.785s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Created reservations ['43b8d3ca-0f55-4338-b142-a402e8059f80', 'a9f5049c-c9be-47f0-b195-6012220f94a8', 'd0fe276f-78fc-474a-89f6-bd32f3d0b67a', '2c2c58cc-59c2-4252-84d6-36c9d0d04993'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:25 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:25 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:25 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Deleted volume successfully. Jul 20 16:54:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d47e4b84-862d-49ff-8fb9-1bb84905a642 tempest-CreateVolumesFromSnapshotTest-40517512 None] Lock "cinder-a96de7b6-9f9e-4c4e-adcf-1db954ff28ba-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-a8fc1a58-8f81-45ed-871d-b0c2520263ca req-5f37e468-f981-4a5a-94fa-2f8bcd992ff3 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Terminate volume connection completed successfully. Jul 20 16:54:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-a8fc1a58-8f81-45ed-871d-b0c2520263ca req-5f37e468-f981-4a5a-94fa-2f8bcd992ff3 tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Deleting attachment 3fdedd88-df29-4b14-9982-f2ede83aff7c. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Acquiring lock "cinder-de791c7e-8c45-44b3-8c7c-44d4626e644d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "cinder-de791c7e-8c45-44b3-8c7c-44d4626e644d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=109,cinder:INSERT=31,cinder:UPDATE=109,cinder:DELETE=13 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Acquiring lock "cinder-quobyte-de791c7e-8c45-44b3-8c7c-44d4626e644d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "cinder-quobyte-de791c7e-8c45-44b3-8c7c-44d4626e644d" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff944682-d55d-4e40-92d6-42295b39e681]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:28 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d Jul 20 16:54:28 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:29 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d" returned: 0 in 0.396s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:29 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d Jul 20 16:54:29 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:29 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-de791c7e-8c45-44b3-8c7c-44d4626e644d" returned: 0 in 0.283s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "cinder-quobyte-de791c7e-8c45-44b3-8c7c-44d4626e644d" released by "delete_volume" :: held 0.732s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Created reservations ['13ad2997-8864-4cc1-8fbe-8a303d53ecf9', '1694e5fc-f6b1-4377-958b-923d0cb70271', '77e026fc-c480-43d5-8f0e-021e3285bff1', '9f1a7dce-4ccb-4947-99ef-843f4ebaad7b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:29 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:29 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:30 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.285s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:30 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Deleted volume successfully. Jul 20 16:54:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-a7ce98c6-8eeb-4de8-bb67-4425f721f4da tempest-TestServerVolumeAttachScenarioOldVersion-1437719799 None] Lock "cinder-de791c7e-8c45-44b3-8c7c-44d4626e644d-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:39 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:54:39 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:39 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:54:39 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=20 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:54:40 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Flow 'volume_create_manager' (1f5a10d6-4592-49ac-9027-aeac986fcb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff45512-4017-454e-add2-6e2378b97b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff45512-4017-454e-add2-6e2378b97b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1245511234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1799c1d-21ce-47c7-8041-2da55968ad98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bf50394a2a4882a0fb1bdee45aac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:47Z,use_quota=True,user_id='1dc1a7cef1324258b2c47eb9232338f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2de0db-1e4b-41b6-b78e-6c9bd2fdfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2de0db-1e4b-41b6-b78e-6c9bd2fdfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0943ebba-bf61-4c34-8fba-4a2c006e71a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0943ebba-bf61-4c34-8fba-4a2c006e71a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1799c1d-21ce-47c7-8041-2da55968ad98', 'volume_name': 'volume-f1799c1d-21ce-47c7-8041-2da55968ad98', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a483bab0-ea67-41fe-a81e-a5ee17a54005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a483bab0-ea67-41fe-a81e-a5ee17a54005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6813f64d-fc5f-4f14-a507-d9496fd5214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:47 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Volume f1799c1d-21ce-47c7-8041-2da55968ad98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1799c1d-21ce-47c7-8041-2da55968ad98', 'volume_size': 1} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1245511234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1799c1d-21ce-47c7-8041-2da55968ad98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bf50394a2a4882a0fb1bdee45aac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:47Z,use_quota=True,user_id='1dc1a7cef1324258b2c47eb9232338f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Creating volume f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:47 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:47 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 1073741824 Jul 20 16:54:47 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:47 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 1073741824" returned: 0 in 0.470s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:47 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:54:47 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:48 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6813f64d-fc5f-4f14-a507-d9496fd5214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1799c1d-21ce-47c7-8041-2da55968ad98', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296fbc0-bf74-4efe-b8e1-3c408cb9705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:48 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Volume volume-f1799c1d-21ce-47c7-8041-2da55968ad98 (f1799c1d-21ce-47c7-8041-2da55968ad98): created successfully Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296fbc0-bf74-4efe-b8e1-3c408cb9705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Flow 'volume_create_manager' (1f5a10d6-4592-49ac-9027-aeac986fcb0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-33915d38-3968-4ee8-b2c0-2b368c814150 tempest-SnapshotDependencyTests-951381555 None] Created volume successfully. Jul 20 16:54:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Creating offline snapshot 1e1e74ff-8b4b-427a-a449-8dcc015fd99c of volume f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:54:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b054ab5-ae33-442b-9ae4-3d7db6bf0832]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:49 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:54:49 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:50 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.411s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:50 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c 1G Jul 20 16:54:50 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:50 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c 1G" returned: 0 in 0.437s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1799c1d-21ce-47c7-8041-2da55968ad98 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:50 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1799c1d-21ce-47c7-8041-2da55968ad98 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c Jul 20 16:54:50 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:50 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1799c1d-21ce-47c7-8041-2da55968ad98 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:50 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c is being set with open permissions: ugo+rw Jul 20 16:54:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:50 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c Jul 20 16:54:50 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:51 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c" returned: 0 in 0.244s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:51 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info Jul 20 16:54:51 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:51 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:51 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info is being set with open permissions: ugo+rw Jul 20 16:54:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:51 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info Jul 20 16:54:51 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:51 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.info" returned: 0 in 0.271s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:51 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7e8c3b31-21d8-40f4-a273-9ab08da4f6fa tempest-SnapshotDependencyTests-951381555 None] Create snapshot completed successfully Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Flow 'volume_create_manager' (0fb85a10-8af2-4603-a931-48fd6f96f452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a868f5a-2e63-4df4-8151-0a56768377a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a868f5a-2e63-4df4-8151-0a56768377a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1e4e6c-5f4a-4340-8069-7161e8fc0caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bf50394a2a4882a0fb1bdee45aac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e1e74ff-8b4b-427a-a449-8dcc015fd99c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:54:53Z,use_quota=True,user_id='1dc1a7cef1324258b2c47eb9232338f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc622c8-f46c-4f7f-9560-6254621b9c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc622c8-f46c-4f7f-9560-6254621b9c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89703af8-c7ef-4af0-914a-d68a4bd0ffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89703af8-c7ef-4af0-914a-d68a4bd0ffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5c1e4e6c-5f4a-4340-8069-7161e8fc0caa', 'volume_name': 'volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa', 'volume_size': 1, 'snapshot_id': '1e1e74ff-8b4b-427a-a449-8dcc015fd99c'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e996af-f810-4ad9-8932-007eb10fb3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e996af-f810-4ad9-8932-007eb10fb3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beabbb98-4c3d-4a3f-ba12-7868488ef6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:54:53 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Volume 5c1e4e6c-5f4a-4340-8069-7161e8fc0caa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa', 'volume_size': 1, 'snapshot_id': '1e1e74ff-8b4b-427a-a449-8dcc015fd99c'} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-quobyte-1e1e74ff-8b4b-427a-a449-8dcc015fd99c-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-1e1e74ff-8b4b-427a-a449-8dcc015fd99c-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Creating volume 5c1e4e6c-5f4a-4340-8069-7161e8fc0caa from snapshot 1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-quobyte-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] snapshot: 1e1e74ff-8b4b-427a-a449-8dcc015fd99c, volume: 5c1e4e6c-5f4a-4340-8069-7161e8fc0caa, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb13db-3b2f-4305-bddd-6eb7b603cf80]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:53 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c Jul 20 16:54:53 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:53 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c" returned: 0 in 0.367s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1799c1d-21ce-47c7-8041-2da55968ad98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:54:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:54:54 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f077dee-4d3b-4e08-b326-b30588dbcb49]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:54 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:54:54 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:54 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.418s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:54 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:54:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:54:54 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa Jul 20 16:54:54 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:54:59 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 20 16:54:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" returned: 0 in 5.481s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:54:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb9e85-9a7d-4d5e-a5a9-9f337049b3dc]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:54:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:00 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:55:00 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:00 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.735s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:55:00 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Converted 1024.00 MB image at 186.75 MB/s Jul 20 16:55:00 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa is being set with open permissions: ugo+rw Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:00 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa Jul 20 16:55:00 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:00 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" returned: 0 in 0.258s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" released by "_copy_volume_from_snapshot" :: held 7.375s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-1e1e74ff-8b4b-427a-a449-8dcc015fd99c-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" released by "_create_volume_from_snapshot" :: held 7.407s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.429s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.462s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6f7ad-432d-431c-b96c-9502f88a23a3]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beabbb98-4c3d-4a3f-ba12-7868488ef6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa', 'volume_size': 1, 'snapshot_id': '1e1e74ff-8b4b-427a-a449-8dcc015fd99c'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db92c28-97fe-435d-a6ff-8d533e75748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Volume volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa (5c1e4e6c-5f4a-4340-8069-7161e8fc0caa): created successfully Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db92c28-97fe-435d-a6ff-8d533e75748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Flow 'volume_create_manager' (0fb85a10-8af2-4603-a931-48fd6f96f452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:55:01 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-dccd584b-79ee-4332-9248-a9d647ef285a tempest-SnapshotDependencyTests-951381555 None] Created volume successfully. Jul 20 16:55:01 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 Jul 20 16:55:01 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-1e1e74ff-8b4b-427a-a449-8dcc015fd99c-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-1e1e74ff-8b4b-427a-a449-8dcc015fd99c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-quobyte-f1799c1d-21ce-47c7-8041-2da55968ad98" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-f1799c1d-21ce-47c7-8041-2da55968ad98" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-quobyte-1e1e74ff-8b4b-427a-a449-8dcc015fd99c" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-1e1e74ff-8b4b-427a-a449-8dcc015fd99c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Deleting offline snapshot 1e1e74ff-8b4b-427a-a449-8dcc015fd99c of volume f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:55:01 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] snapshot_file for this snap is: volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7" returned: 0 in 0.463s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.502s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad897834-60e9-45b2-8786-19eef703476a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-f62d9475-53f9-4e51-8f19-800d0977cbe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bda1548c-3a06-44f4-89df-1ba38386d864', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:55:01 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-c707333c-4575-44f3-99ba-a2d44ca93075 req-acd5451f-d8a0-4af8-9115-270cfce4e3c7 tempest-TestStampPattern-778790674 None] attachment_update completed successfully. Jul 20 16:55:01 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c Jul 20 16:55:01 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:01 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c" returned: 0 in 0.474s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1799c1d-21ce-47c7-8041-2da55968ad98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b36f0-fe22-4818-aec7-be9666415511]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:02 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:55:02 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:02 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.481s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:02 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c Jul 20 16:55:02 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:02 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:02 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c Jul 20 16:55:02 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:03 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98.1e1e74ff-8b4b-427a-a449-8dcc015fd99c" returned: 0 in 0.254s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-1e1e74ff-8b4b-427a-a449-8dcc015fd99c" released by "_delete_snapshot" :: held 1.738s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-f1799c1d-21ce-47c7-8041-2da55968ad98" released by "delete_snapshot" :: held 1.762s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Created reservations ['b3d05a93-ac6d-411f-a6a3-9c7d7a2ff453', '119268de-c724-4181-8ea3-7547fb72deb7', 'e8338043-ff20-4700-9829-fb50ad2e1616', '13688c1c-76e5-408c-9522-e95fc4820f65'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Delete snapshot completed successfully. Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-097ef0c2-7607-440d-8608-d62918aa2169 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-1e1e74ff-8b4b-427a-a449-8dcc015fd99c-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-f1799c1d-21ce-47c7-8041-2da55968ad98-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-f1799c1d-21ce-47c7-8041-2da55968ad98-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-quobyte-f1799c1d-21ce-47c7-8041-2da55968ad98" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-f1799c1d-21ce-47c7-8041-2da55968ad98" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f14ec-7e4a-451f-83b3-3d7fe56383b8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:03 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:55:03 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:04 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.459s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:04 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98 Jul 20 16:55:04 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:04 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f1799c1d-21ce-47c7-8041-2da55968ad98" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-f1799c1d-21ce-47c7-8041-2da55968ad98" released by "delete_volume" :: held 0.902s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Created reservations ['01a40593-9dd7-4e60-8a42-889732705dc8', '09391e92-50a4-4f87-a2ba-b12cf6a7b69d', '4f15b42e-c347-497a-b694-350073956a85', '087d80dd-e6e2-4954-833a-fa6b459d71a1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:04 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:55:04 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "cinder-quobyte-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:04 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc428ee-119a-4246-8a08-34c49f0497e6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-7f00637d-d0ea-479f-99e7-26860d8668e4 req-c07a61ea-c18d-44d6-9d06-4c7b8ed7e237 tempest-TestStampPattern-778790674 None] Terminate volume connection completed successfully. Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-7f00637d-d0ea-479f-99e7-26860d8668e4 req-c07a61ea-c18d-44d6-9d06-4c7b8ed7e237 tempest-TestStampPattern-778790674 None] Deleting attachment bda1548c-3a06-44f4-89df-1ba38386d864. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:55:05 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.349s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:55:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Deleted volume successfully. Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-41ce6090-8fec-4c04-b5a4-64a55f7958a5 tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-f1799c1d-21ce-47c7-8041-2da55968ad98-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:05 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa Jul 20 16:55:05 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:05 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" returned: 0 in 0.456s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:05 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa Jul 20 16:55:05 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:05 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" returned: 0 in 0.319s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-quobyte-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa" released by "delete_volume" :: held 0.841s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Created reservations ['33aba971-b66f-49aa-8a2a-932c640999ee', '9cdf5453-23cb-4680-b559-9111943185dd', '60099e88-057f-47b3-8a03-e16213cfdbca', '2442753a-0609-45cf-aabc-7b05772fea2e'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:05 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:55:05 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:06 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:06 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:55:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Deleted volume successfully. Jul 20 16:55:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8e401bf6-983e-4d15-9d02-6f05330d79bd tempest-SnapshotDependencyTests-951381555 None] Lock "cinder-5c1e4e6c-5f4a-4340-8069-7161e8fc0caa-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-f62d9475-53f9-4e51-8f19-800d0977cbe7-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Lock "cinder-f62d9475-53f9-4e51-8f19-800d0977cbe7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-quobyte-f62d9475-53f9-4e51-8f19-800d0977cbe7" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-f62d9475-53f9-4e51-8f19-800d0977cbe7" acquired by "delete_volume" :: waited 0.043s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a9790-b42f-4d07-ad2b-fc0d32e0bfbe]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:12 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 Jul 20 16:55:12 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:12 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7" returned: 0 in 0.410s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:12 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7 Jul 20 16:55:12 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:12 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f62d9475-53f9-4e51-8f19-800d0977cbe7" returned: 0 in 0.293s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-f62d9475-53f9-4e51-8f19-800d0977cbe7" released by "delete_volume" :: held 0.760s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Created reservations ['fa655c78-8b8d-4c7d-a608-295933fc8fbd', '6c091930-9945-49a5-ac89-b689d685b94c', 'f767a4b7-ea5f-4990-93ec-f4ce997b05c7', '96bd5235-b73d-4450-9b49-c171aecb8231'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:12 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:55:12 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:13 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.320s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:55:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Deleted volume successfully. Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-dc10ae43-90ee-4502-9b8f-9fdbab2a88cd tempest-TestStampPattern-778790674 None] Lock "cinder-f62d9475-53f9-4e51-8f19-800d0977cbe7-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-72435b74-0f6e-470f-a33e-6e94ab09d83f-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Lock "cinder-72435b74-0f6e-470f-a33e-6e94ab09d83f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-quobyte-106d18f6-47ac-4f01-a59f-ccace072a32a" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-106d18f6-47ac-4f01-a59f-ccace072a32a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-quobyte-72435b74-0f6e-470f-a33e-6e94ab09d83f" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-72435b74-0f6e-470f-a33e-6e94ab09d83f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Deleting offline snapshot 72435b74-0f6e-470f-a33e-6e94ab09d83f of volume 106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] snapshot_file for this snap is: volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[188471dd-1f47-4202-aa66-688c9ad3c0fa]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:13 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f Jul 20 16:55:13 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:14 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f" returned: 0 in 0.516s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106d18f6-47ac-4f01-a59f-ccace072a32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:55:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d150172-8614-44ef-b8e6-6b0b200929c6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:14 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:55:14 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:14 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.494s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:14 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f Jul 20 16:55:14 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:15 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f" returned: 0 in 0.510s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:15 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f Jul 20 16:55:15 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:15 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a.72435b74-0f6e-470f-a33e-6e94ab09d83f" returned: 0 in 0.366s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-72435b74-0f6e-470f-a33e-6e94ab09d83f" released by "_delete_snapshot" :: held 2.039s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-106d18f6-47ac-4f01-a59f-ccace072a32a" released by "delete_snapshot" :: held 2.078s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Created reservations ['2fdbdd59-e906-4410-ad17-652271d73779', 'e80b75ac-0878-43ce-8a1a-1c004d6920a8', '24a883e1-50d4-40e8-ad1f-3d6111d2f9eb', 'e891ab56-e9f2-42ff-85da-3d6975998044'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Delete snapshot completed successfully. Jul 20 16:55:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-af3893b7-7c0e-4e22-9029-68209211f318 tempest-TestStampPattern-778790674 None] Lock "cinder-72435b74-0f6e-470f-a33e-6e94ab09d83f-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Flow 'volume_create_manager' (078abdd9-41e0-4e1b-9025-47ae1c705c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f972bb-1acf-4523-8b5d-29dea060636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f972bb-1acf-4523-8b5d-29dea060636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-262371444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9e836c-172c-467e-9aaa-ca1759d10a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b4ec336184411396fb9ec119c26ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:55:21Z,use_quota=True,user_id='7a690af33b054a88a85533fb3200e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b110650f-e0c5-4806-8eda-1aab554bb1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b110650f-e0c5-4806-8eda-1aab554bb1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b0cae5-bd2b-4822-a4c2-abc780d129d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-106d18f6-47ac-4f01-a59f-ccace072a32a-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Lock "cinder-106d18f6-47ac-4f01-a59f-ccace072a32a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Acquiring lock "cinder-quobyte-106d18f6-47ac-4f01-a59f-ccace072a32a" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-106d18f6-47ac-4f01-a59f-ccace072a32a" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b0cae5-bd2b-4822-a4c2-abc780d129d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f9e836c-172c-467e-9aaa-ca1759d10a5d', 'volume_name': 'volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8bc64-e940-4a48-8e2e-41ed4bef62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8bc64-e940-4a48-8e2e-41ed4bef62de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399abd6e-21c9-4c29-9c07-e006156cbf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Volume 8f9e836c-172c-467e-9aaa-ca1759d10a5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Trying to clone 8f9e836c-172c-467e-9aaa-ca1759d10a5d from image aa995944-e655-43b4-81e9-d04027d5b275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b228fe1b-dcef-46a6-be06-d4e8e0f29275]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:21 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:55:21 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:55:22 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Image download 20.69 MB at 20.69 MB/s Jul 20 16:55:22 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.413s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:22 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a Jul 20 16:55:22 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[082d1a77-f401-4497-9de6-8ca2cd6d8281]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:22 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD Jul 20 16:55:22 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:22 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-106d18f6-47ac-4f01-a59f-ccace072a32a" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Lock "cinder-quobyte-106d18f6-47ac-4f01-a59f-ccace072a32a" released by "delete_volume" :: held 0.752s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Created reservations ['e1260fe6-4320-4803-98aa-22a7eb3f703d', '0856f06e-07fb-47a6-9b20-0a6a2620d48f', 'de15dd52-a4f3-47f7-8746-daf4b6ea5776', 'e179397c-fa17-479e-a9e7-c98e12819429'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:22 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 is fetched for user 7a690af33b054a88a85533fb3200e2b6. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:22 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:55:22 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b2481d-89c6-45d1-813f-d909e802f5b7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:22 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD Jul 20 16:55:22 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:22 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:55:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Deleted volume successfully. Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c255317-95df-4987-a930-798326fb2e7d tempest-TestStampPattern-778790674 None] Lock "cinder-106d18f6-47ac-4f01-a59f-ccace072a32a-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:22 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-262371444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9e836c-172c-467e-9aaa-ca1759d10a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b4ec336184411396fb9ec119c26ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:55:21Z,use_quota=True,user_id='7a690af33b054a88a85533fb3200e2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Creating volume 8f9e836c-172c-467e-9aaa-ca1759d10a5d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:55:22 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:55:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:22 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d 1073741824 Jul 20 16:55:22 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:23 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d 1073741824" returned: 0 in 0.467s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:23 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d Jul 20 16:55:23 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:23 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d" returned: 0 in 0.248s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Attempting download of aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 8f9e836c-172c-467e-9aaa-ca1759d10a5d. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b535f78-b7e6-4900-b20e-9ec1e56d2914]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:23 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a Jul 20 16:55:23 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:24 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:24 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a Jul 20 16:55:24 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:24 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a" returned: 1 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa995944-e655-43b4-81e9-d04027d5b275_yi2v7i1a' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7004f-e406-40d2-9ba9-58f46a05bf92]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:24 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD Jul 20 16:55:24 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:24 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] aa995944-e655-43b4-81e9-d04027d5b275 was qcow2, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:55:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:24 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d Jul 20 16:55:24 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:26 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d" returned: 0 in 1.675s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa995944-e655-43b4-81e9-d04027d5b275_stunl4x0devstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:55:26 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Converted 112.00 MB image at 66.83 MB/s Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:26 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d 1G Jul 20 16:55:26 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:26 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d 1G" returned: 0 in 0.340s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Downloaded image aa995944-e655-43b4-81e9-d04027d5b275 ((None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}])) to volume 8f9e836c-172c-467e-9aaa-ca1759d10a5d successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Temporary image aa995944-e655-43b4-81e9-d04027d5b275 for user 7a690af33b054a88a85533fb3200e2b6 is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Marking volume 8f9e836c-172c-467e-9aaa-ca1759d10a5d as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Copying metadata from image aa995944-e655-43b4-81e9-d04027d5b275 to 8f9e836c-172c-467e-9aaa-ca1759d10a5d. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Creating volume glance metadata for volume 8f9e836c-172c-467e-9aaa-ca1759d10a5d backed by image aa995944-e655-43b4-81e9-d04027d5b275 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399abd6e-21c9-4c29-9c07-e006156cbf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d', 'volume_size': 1, 'image_id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa995944-e655-43b4-81e9-d04027d5b275', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0f64eb596974441c998f91ea1ba03dca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa995944-e655-43b4-81e9-d04027d5b275', 'created_at': datetime.datetime(2026, 7, 20, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 35, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa995944-e655-43b4-81e9-d04027d5b275/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fb3153-750a-481c-9d6e-f6a499e28104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:26 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Volume volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d (8f9e836c-172c-467e-9aaa-ca1759d10a5d): created successfully Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fb3153-750a-481c-9d6e-f6a499e28104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Flow 'volume_create_manager' (078abdd9-41e0-4e1b-9025-47ae1c705c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:55:26 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0ebe2286-b10b-43cf-a00b-6fc403e3c8d8 tempest-TestShelveInstance-1723017229 None] Created volume successfully. Jul 20 16:55:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c886d513-b931-4c05-be52-49a5463b7c02 req-ff33d4d0-ef04-4f91-a3da-a1a29446c8a9 tempest-TestShelveInstance-1723017229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c886d513-b931-4c05-be52-49a5463b7c02 req-ff33d4d0-ef04-4f91-a3da-a1a29446c8a9 tempest-TestShelveInstance-1723017229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-c886d513-b931-4c05-be52-49a5463b7c02 req-ff33d4d0-ef04-4f91-a3da-a1a29446c8a9 tempest-TestShelveInstance-1723017229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-c886d513-b931-4c05-be52-49a5463b7c02 req-ff33d4d0-ef04-4f91-a3da-a1a29446c8a9 tempest-TestShelveInstance-1723017229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56799301-38f7-4d16-97bb-15dc3d5f54d1', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:55:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-c886d513-b931-4c05-be52-49a5463b7c02 req-ff33d4d0-ef04-4f91-a3da-a1a29446c8a9 tempest-TestShelveInstance-1723017229 None] attachment_update completed successfully. Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Flow 'volume_create_manager' (bbeb2f21-07b9-4fa2-ba0a-840f93b84d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629a984e-d398-4f6e-aeb9-4071e9b14b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629a984e-d398-4f6e-aeb9-4071e9b14b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdf6906-29f1-4391-9990-9cc33a4d176c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576237d2cdfa4e49852ceeada82629f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:55:37Z,use_quota=True,user_id='ed7e3cdf585047d0a15fe756cd38d8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b708e8fe-6cb5-4380-b3e7-5d3f584fe789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b708e8fe-6cb5-4380-b3e7-5d3f584fe789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ca7ea0-19fa-4371-a045-f080e461c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ca7ea0-19fa-4371-a045-f080e461c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfdf6906-29f1-4391-9990-9cc33a4d176c', 'volume_name': 'volume-cfdf6906-29f1-4391-9990-9cc33a4d176c', 'volume_size': 1, 'image_id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '341cf4da9d875ffa4f03d9e2d6e9d2cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '576237d2cdfa4e49852ceeada82629f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '755ccc3e20be8acbf003babc9d23eb784ffd18fe81793e10d4641c48866b25aba005eda9c3e12e794b1bb4e62a4950b9b86b855cf7f0182139bc7945aaa1c43a', 'id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'created_at': datetime.datetime(2026, 7, 20, 14, 55, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 55, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f/file', 'properties': {}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93939e89-b907-4854-b055-8ea9784289b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93939e89-b907-4854-b055-8ea9784289b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b587bb5-b7f5-4e55-889e-8e071222c785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:37 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Volume cfdf6906-29f1-4391-9990-9cc33a4d176c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfdf6906-29f1-4391-9990-9cc33a4d176c', 'volume_size': 1, 'image_id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '341cf4da9d875ffa4f03d9e2d6e9d2cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '576237d2cdfa4e49852ceeada82629f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '755ccc3e20be8acbf003babc9d23eb784ffd18fe81793e10d4641c48866b25aba005eda9c3e12e794b1bb4e62a4950b9b86b855cf7f0182139bc7945aaa1c43a', 'id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'created_at': datetime.datetime(2026, 7, 20, 14, 55, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 55, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f/file', 'properties': {}}, 'image_service': } Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Trying to clone cfdf6906-29f1-4391-9990-9cc33a4d176c from image 5ec17748-ef55-44ec-96e9-59c18d5b8c4f at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:55:37 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Image download 0.00 MB at 0.00 MB/s Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd44f60-a827-4a40-89a3-50afc1ddd774]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:37 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD Jul 20 16:55:37 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:38 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:38 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD Jul 20 16:55:38 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:38 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Temporary image 5ec17748-ef55-44ec-96e9-59c18d5b8c4f is fetched for user ed7e3cdf585047d0a15fe756cd38d8ca. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c7e26-7b9b-4687-87a0-96c964b47fc6]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:38 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD Jul 20 16:55:38 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:39 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:39 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD Jul 20 16:55:39 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:39 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:55:39 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:39 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdf6906-29f1-4391-9990-9cc33a4d176c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576237d2cdfa4e49852ceeada82629f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:55:37Z,use_quota=True,user_id='ed7e3cdf585047d0a15fe756cd38d8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Creating volume cfdf6906-29f1-4391-9990-9cc33a4d176c {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:55:39 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:39 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c 1073741824 Jul 20 16:55:39 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:39 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:55:39 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c 1073741824" returned: 0 in 0.449s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=63,cinder:INSERT=20,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:55:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:39 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c Jul 20 16:55:39 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:40 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c" returned: 0 in 0.260s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Attempting download of 5ec17748-ef55-44ec-96e9-59c18d5b8c4f ((None, [{'url': 'file:///opt/stack/data/glance/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'metadata': {}}])) to volume cfdf6906-29f1-4391-9990-9cc33a4d176c. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09ecd0-930f-4513-a9b3-00b2ff8466e2]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:40 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414 Jul 20 16:55:40 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:40 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414" returned: 0 in 0.333s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:40 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414 Jul 20 16:55:40 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:40 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414" returned: 1 in 0.339s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_uwiqt414' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa942a-fa26-4a1e-a08a-557caa1d4331]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:41 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD Jul 20 16:55:41 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:41 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:41 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD Jul 20 16:55:41 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:41 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:55:41 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] 5ec17748-ef55-44ec-96e9-59c18d5b8c4f was raw, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:55:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:41 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c Jul 20 16:55:41 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:42 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c" returned: 0 in 0.444s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ec17748-ef55-44ec-96e9-59c18d5b8c4f_fht0lbggdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:55:42 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Converted 0.00 MB image at 0.00 MB/s Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:42 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c 1G Jul 20 16:55:42 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:42 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c 1G" returned: 0 in 0.318s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Downloaded image 5ec17748-ef55-44ec-96e9-59c18d5b8c4f ((None, [{'url': 'file:///opt/stack/data/glance/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'metadata': {}}])) to volume cfdf6906-29f1-4391-9990-9cc33a4d176c successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Temporary image 5ec17748-ef55-44ec-96e9-59c18d5b8c4f for user ed7e3cdf585047d0a15fe756cd38d8ca is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Marking volume cfdf6906-29f1-4391-9990-9cc33a4d176c as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=65,cinder:SELECT=68,cinder:DELETE=4,cinder:INSERT=22 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Copying metadata from image 5ec17748-ef55-44ec-96e9-59c18d5b8c4f to cfdf6906-29f1-4391-9990-9cc33a4d176c. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Creating volume glance metadata for volume cfdf6906-29f1-4391-9990-9cc33a4d176c backed by image 5ec17748-ef55-44ec-96e9-59c18d5b8c4f with: {'image_id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '341cf4da9d875ffa4f03d9e2d6e9d2cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b587bb5-b7f5-4e55-889e-8e071222c785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdf6906-29f1-4391-9990-9cc33a4d176c', 'volume_size': 1, 'image_id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '341cf4da9d875ffa4f03d9e2d6e9d2cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '576237d2cdfa4e49852ceeada82629f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '755ccc3e20be8acbf003babc9d23eb784ffd18fe81793e10d4641c48866b25aba005eda9c3e12e794b1bb4e62a4950b9b86b855cf7f0182139bc7945aaa1c43a', 'id': '5ec17748-ef55-44ec-96e9-59c18d5b8c4f', 'created_at': datetime.datetime(2026, 7, 20, 14, 55, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 55, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ec17748-ef55-44ec-96e9-59c18d5b8c4f/file', 'properties': {}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320392e0-118f-469c-a27d-ffa38443a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:55:42 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Volume volume-cfdf6906-29f1-4391-9990-9cc33a4d176c (cfdf6906-29f1-4391-9990-9cc33a4d176c): created successfully Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320392e0-118f-469c-a27d-ffa38443a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:55:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Flow 'volume_create_manager' (bbeb2f21-07b9-4fa2-ba0a-840f93b84d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:55:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-84464bdf-a5e2-4f45-a4e1-ddb3231d29da tempest-VolumeImageDependencyTests-670244987 None] Created volume successfully. Jul 20 16:55:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Acquiring lock "cinder-cfdf6906-29f1-4391-9990-9cc33a4d176c-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Lock "cinder-cfdf6906-29f1-4391-9990-9cc33a4d176c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Acquiring lock "cinder-quobyte-cfdf6906-29f1-4391-9990-9cc33a4d176c" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:55:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Lock "cinder-quobyte-cfdf6906-29f1-4391-9990-9cc33a4d176c" acquired by "delete_volume" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:55:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[690ae7cf-8a26-40c3-b706-b121d9d0f928]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:55:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:43 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c Jul 20 16:55:43 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:44 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c" returned: 0 in 0.361s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:44 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c Jul 20 16:55:44 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:44 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cfdf6906-29f1-4391-9990-9cc33a4d176c" returned: 0 in 0.252s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Lock "cinder-quobyte-cfdf6906-29f1-4391-9990-9cc33a4d176c" released by "delete_volume" :: held 0.657s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Created reservations ['466d8031-27a2-4198-9d93-53a60b7d3a07', '97b402b3-d07e-4da2-8a06-7861f0bf6ac6', '141750bc-ee6a-4a39-8c58-4b74dd803a18', '91ede5c5-0da6-4b97-9cbb-1cdf257c1444'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:55:44 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:55:44 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:55:44 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:55:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Deleted volume successfully. Jul 20 16:55:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e191dcb6-95d9-41c7-b6b3-2e69da6322d0 tempest-VolumeImageDependencyTests-670244987 None] Lock "cinder-cfdf6906-29f1-4391-9990-9cc33a4d176c-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:55:54 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=11,cinder:SELECT=12,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:55:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:INSERT=4,cinder:SELECT=8,cinder:UPDATE=11 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:56:01 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-7ff53905-4036-4414-8cbd-74b79dd41bc6 req-ca7e04c0-9867-4fa8-a387-297879dd32bc tempest-TestShelveInstance-1723017229 None] Terminate volume connection completed successfully. Jul 20 16:56:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-7ff53905-4036-4414-8cbd-74b79dd41bc6 req-ca7e04c0-9867-4fa8-a387-297879dd32bc tempest-TestShelveInstance-1723017229 None] Deleting attachment 56799301-38f7-4d16-97bb-15dc3d5f54d1. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:56:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-0b87f193-8998-437b-9352-f7518333cfb1 req-5362640c-002d-4a4d-80d0-f2eb161c4ff0 tempest-TestShelveInstance-1723017229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:56:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-0b87f193-8998-437b-9352-f7518333cfb1 req-5362640c-002d-4a4d-80d0-f2eb161c4ff0 tempest-TestShelveInstance-1723017229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:56:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-0b87f193-8998-437b-9352-f7518333cfb1 req-5362640c-002d-4a4d-80d0-f2eb161c4ff0 tempest-TestShelveInstance-1723017229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:56:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-0b87f193-8998-437b-9352-f7518333cfb1 req-5362640c-002d-4a4d-80d0-f2eb161c4ff0 tempest-TestShelveInstance-1723017229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2', 'name': 'volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d8b6034-c9ec-4c8a-98e5-8b493fbf7f44', 'enforce_multipath': True} {{(pid=87535) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 20 16:56:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-0b87f193-8998-437b-9352-f7518333cfb1 req-5362640c-002d-4a4d-80d0-f2eb161c4ff0 tempest-TestShelveInstance-1723017229 None] attachment_update completed successfully. Jul 20 16:56:13 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:56:13 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:39 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:56:39 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:39 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.238s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:56:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:56:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-7949a819-2060-42a3-ab21-49f6701026fb req-2148bc05-fdbb-4374-8015-54d39eab3379 tempest-TestShelveInstance-1723017229 None] Terminate volume connection completed successfully. Jul 20 16:56:45 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [req-7949a819-2060-42a3-ab21-49f6701026fb req-2148bc05-fdbb-4374-8015-54d39eab3379 tempest-TestShelveInstance-1723017229 None] Deleting attachment 3d8b6034-c9ec-4c8a-98e5-8b493fbf7f44. {{(pid=87535) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Acquiring lock "cinder-8f9e836c-172c-467e-9aaa-ca1759d10a5d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Lock "cinder-8f9e836c-172c-467e-9aaa-ca1759d10a5d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Acquiring lock "cinder-quobyte-8f9e836c-172c-467e-9aaa-ca1759d10a5d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Lock "cinder-quobyte-8f9e836c-172c-467e-9aaa-ca1759d10a5d" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dcc318-045f-4cfc-9fdb-7ef97306c979]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:46 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d Jul 20 16:56:46 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:46 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d" returned: 0 in 0.380s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:46 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d Jul 20 16:56:46 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:46 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-8f9e836c-172c-467e-9aaa-ca1759d10a5d" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Lock "cinder-quobyte-8f9e836c-172c-467e-9aaa-ca1759d10a5d" released by "delete_volume" :: held 0.669s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.quota [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Created reservations ['a9a406b5-9be2-435d-9745-12de4c6613f3', '1881a8ef-238c-4729-91e7-c0d2a90944db', '35508910-3ff6-427c-8227-07f4774732d2', '78f06dc6-e2a7-4695-971b-5300310c820e'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:56:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:46 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:56:46 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:47 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.252s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:47 devstack cinder-volume[87535]: DEBUG cinder.manager [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:56:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Deleted volume successfully. Jul 20 16:56:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [req-7949a819-2060-42a3-ab21-49f6701026fb req-c6e5e22d-d98f-4ed8-8c55-260721caddc2 tempest-TestShelveInstance-1723017229 None] Lock "cinder-8f9e836c-172c-467e-9aaa-ca1759d10a5d-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Flow 'volume_create_manager' (73c4db34-968f-4b5b-9d73-154a507071db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52992f8-e661-4317-8001-22155737edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52992f8-e661-4317-8001-22155737edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-96472402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721d3a41-8f21-40f4-965f-eba23e9dda12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97631973eedc4b5c80ca30a3e4cf080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:56:57Z,use_quota=True,user_id='045a2601a67341f795f5db3d41c582ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12a52b0-9c6d-4aad-83fb-47d30aeb3ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12a52b0-9c6d-4aad-83fb-47d30aeb3ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b31e11-01fc-43a8-8189-5179ff6aa4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b31e11-01fc-43a8-8189-5179ff6aa4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721d3a41-8f21-40f4-965f-eba23e9dda12', 'volume_name': 'volume-721d3a41-8f21-40f4-965f-eba23e9dda12', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e5fd95-46f4-426a-970d-dbd2f5f24986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e5fd95-46f4-426a-970d-dbd2f5f24986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54a2cbe-75b8-4877-a0a4-04c2fa0a148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:56:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Volume 721d3a41-8f21-40f4-965f-eba23e9dda12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721d3a41-8f21-40f4-965f-eba23e9dda12', 'volume_size': 1} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-96472402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721d3a41-8f21-40f4-965f-eba23e9dda12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97631973eedc4b5c80ca30a3e4cf080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:56:57Z,use_quota=True,user_id='045a2601a67341f795f5db3d41c582ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Creating volume 721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:56:56 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:56:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:56 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 1073741824 Jul 20 16:56:56 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:57 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 1073741824" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:57 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:56:57 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:57 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.237s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54a2cbe-75b8-4877-a0a4-04c2fa0a148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721d3a41-8f21-40f4-965f-eba23e9dda12', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6491c4-8e55-4ba7-948d-97dabc17cc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:56:57 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Volume volume-721d3a41-8f21-40f4-965f-eba23e9dda12 (721d3a41-8f21-40f4-965f-eba23e9dda12): created successfully Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6491c4-8e55-4ba7-948d-97dabc17cc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:56:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Flow 'volume_create_manager' (73c4db34-968f-4b5b-9d73-154a507071db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:56:57 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b3690c99-cecf-4dc6-b6ac-a685f7f46715 tempest-VolumeDependencyTests-586003219 None] Created volume successfully. Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Creating offline snapshot ec5d810f-945a-44a0-8502-ad6310e3f92b of volume 721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb4ad1-dd90-4826-86ae-c226173857a6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:58 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:56:58 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:58 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.346s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:58 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b 1G Jul 20 16:56:58 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:58 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b 1G" returned: 0 in 0.375s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721d3a41-8f21-40f4-965f-eba23e9dda12 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:58 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721d3a41-8f21-40f4-965f-eba23e9dda12 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b Jul 20 16:56:58 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:59 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-721d3a41-8f21-40f4-965f-eba23e9dda12 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:59 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b is being set with open permissions: ugo+rw Jul 20 16:56:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:59 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b Jul 20 16:56:59 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:59 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b" returned: 0 in 0.234s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:59 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info Jul 20 16:56:59 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:59 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 20 16:56:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info" returned: 0 in 0.238s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:56:59 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info is being set with open permissions: ugo+rw Jul 20 16:56:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:56:59 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info Jul 20 16:56:59 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:56:59 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.info" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-15e63bb0-afd3-45b8-91de-29a4f9c2edfd tempest-VolumeDependencyTests-586003219 None] Create snapshot completed successfully Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Flow 'volume_create_manager' (3b9c30c7-df45-4d56-a2ce-fdb3052d82e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907d6cb5-d13c-454c-9d6c-c7c4e480fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907d6cb5-d13c-454c-9d6c-c7c4e480fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1157340446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f62bcd-2710-4465-bbdd-807c6e43b830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97631973eedc4b5c80ca30a3e4cf080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec5d810f-945a-44a0-8502-ad6310e3f92b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:01Z,use_quota=True,user_id='045a2601a67341f795f5db3d41c582ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195dedd8-d9d2-4d47-9d01-17ce9ff872f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195dedd8-d9d2-4d47-9d01-17ce9ff872f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4397f2-e3a8-4a79-8f0a-2136a538057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b4397f2-e3a8-4a79-8f0a-2136a538057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32f62bcd-2710-4465-bbdd-807c6e43b830', 'volume_name': 'volume-32f62bcd-2710-4465-bbdd-807c6e43b830', 'volume_size': 1, 'snapshot_id': 'ec5d810f-945a-44a0-8502-ad6310e3f92b'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1436c41a-3125-4562-b04e-593d63ee277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1436c41a-3125-4562-b04e-593d63ee277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f9049a-037e-457a-b0c6-86570de537b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:00 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Volume 32f62bcd-2710-4465-bbdd-807c6e43b830: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32f62bcd-2710-4465-bbdd-807c6e43b830', 'volume_size': 1, 'snapshot_id': 'ec5d810f-945a-44a0-8502-ad6310e3f92b'} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-quobyte-ec5d810f-945a-44a0-8502-ad6310e3f92b-32f62bcd-2710-4465-bbdd-807c6e43b830" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-ec5d810f-945a-44a0-8502-ad6310e3f92b-32f62bcd-2710-4465-bbdd-807c6e43b830" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Creating volume 32f62bcd-2710-4465-bbdd-807c6e43b830 from snapshot ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-quobyte-32f62bcd-2710-4465-bbdd-807c6e43b830" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-32f62bcd-2710-4465-bbdd-807c6e43b830" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] snapshot: ec5d810f-945a-44a0-8502-ad6310e3f92b, volume: 32f62bcd-2710-4465-bbdd-807c6e43b830, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852ca8e-4dcd-4a02-bb24-586cb4555d4b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:01 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b Jul 20 16:57:01 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:01 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b" returned: 0 in 0.356s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-721d3a41-8f21-40f4-965f-eba23e9dda12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ff40a-1042-4a1e-aa0f-a97834a0fbbb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:01 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:57:01 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:01 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.355s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:57:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:01 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 Jul 20 16:57:01 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:05 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830" returned: 0 in 4.016s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:05 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6163a7ca-01f6-44b9-bde6-dab0088ba76e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:05 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:57:05 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:06 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.527s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12, size 1024.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:57:06 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Converted 1024.00 MB image at 254.86 MB/s Jul 20 16:57:06 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 is being set with open permissions: ugo+rw Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:06 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 Jul 20 16:57:06 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:06 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830" returned: 0 in 0.234s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-32f62bcd-2710-4465-bbdd-807c6e43b830" released by "_copy_volume_from_snapshot" :: held 5.571s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-ec5d810f-945a-44a0-8502-ad6310e3f92b-32f62bcd-2710-4465-bbdd-807c6e43b830" released by "_create_volume_from_snapshot" :: held 5.596s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.610s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f9049a-037e-457a-b0c6-86570de537b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f62bcd-2710-4465-bbdd-807c6e43b830', 'volume_size': 1, 'snapshot_id': 'ec5d810f-945a-44a0-8502-ad6310e3f92b'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c77fd99-f6ee-49ba-98ee-2baa9cd36abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Volume volume-32f62bcd-2710-4465-bbdd-807c6e43b830 (32f62bcd-2710-4465-bbdd-807c6e43b830): created successfully Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c77fd99-f6ee-49ba-98ee-2baa9cd36abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Flow 'volume_create_manager' (3b9c30c7-df45-4d56-a2ce-fdb3052d82e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c708b734-5870-436c-b510-5fe7089b0c10 tempest-VolumeDependencyTests-586003219 None] Created volume successfully. Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-ec5d810f-945a-44a0-8502-ad6310e3f92b-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-ec5d810f-945a-44a0-8502-ad6310e3f92b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-quobyte-721d3a41-8f21-40f4-965f-eba23e9dda12" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-721d3a41-8f21-40f4-965f-eba23e9dda12" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-quobyte-ec5d810f-945a-44a0-8502-ad6310e3f92b" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-ec5d810f-945a-44a0-8502-ad6310e3f92b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Deleting offline snapshot ec5d810f-945a-44a0-8502-ad6310e3f92b of volume 721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] snapshot_file for this snap is: volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3756777b-5e1f-4f90-a043-fd34e37c8fa6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:07 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b Jul 20 16:57:07 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:07 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-721d3a41-8f21-40f4-965f-eba23e9dda12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f816621-4c3b-4009-8d9a-2402e092a193]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:07 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:57:07 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:08 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:08 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b Jul 20 16:57:08 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:08 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b" returned: 0 in 0.325s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:08 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b Jul 20 16:57:08 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:08 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12.ec5d810f-945a-44a0-8502-ad6310e3f92b" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-ec5d810f-945a-44a0-8502-ad6310e3f92b" released by "_delete_snapshot" :: held 1.349s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-721d3a41-8f21-40f4-965f-eba23e9dda12" released by "delete_snapshot" :: held 1.369s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Created reservations ['53d9cd39-0569-4ffd-9055-d14bf63977d7', '090736b8-0c49-49d8-9e11-521da19760f7', '91d430dc-6b5f-4406-ba2b-415cd6cb82c6', '8f7e254a-5823-4171-b551-168473f6dd34'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Delete snapshot completed successfully. Jul 20 16:57:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-08920bd9-d7a7-46c0-ba0e-764a9ad15d66 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-ec5d810f-945a-44a0-8502-ad6310e3f92b-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-721d3a41-8f21-40f4-965f-eba23e9dda12-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-721d3a41-8f21-40f4-965f-eba23e9dda12-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-quobyte-721d3a41-8f21-40f4-965f-eba23e9dda12" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-721d3a41-8f21-40f4-965f-eba23e9dda12" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[477f7cc3-82c0-467a-bdf1-d07015ece544]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:09 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:57:09 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:09 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.359s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:09 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12 Jul 20 16:57:09 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:10 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-721d3a41-8f21-40f4-965f-eba23e9dda12" returned: 0 in 0.245s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-721d3a41-8f21-40f4-965f-eba23e9dda12" released by "delete_volume" :: held 0.656s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Created reservations ['a0a85e2a-7f79-4186-acee-a97e3353f77c', 'a6d9538b-7ca0-443e-a618-f1bcde2a816f', '4ae98ecb-c224-427e-b935-dd105683b699', 'f3977d85-4fc2-49f4-ae70-65000cae5c8b'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:10 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:10 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:10 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.235s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:10 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Deleted volume successfully. Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc10ab6f-c8cb-465c-99bd-387be6881685 tempest-VolumeDependencyTests-586003219 None] Lock "cinder-721d3a41-8f21-40f4-965f-eba23e9dda12-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-32f62bcd-2710-4465-bbdd-807c6e43b830-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Lock "cinder-32f62bcd-2710-4465-bbdd-807c6e43b830-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Acquiring lock "cinder-quobyte-32f62bcd-2710-4465-bbdd-807c6e43b830" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-32f62bcd-2710-4465-bbdd-807c6e43b830" acquired by "delete_volume" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55799e-54be-40de-ac8e-180867e5b8e5]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:10 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 Jul 20 16:57:10 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:10 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830" returned: 0 in 0.355s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:11 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830 Jul 20 16:57:11 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:11 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-32f62bcd-2710-4465-bbdd-807c6e43b830" returned: 0 in 0.238s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Lock "cinder-quobyte-32f62bcd-2710-4465-bbdd-807c6e43b830" released by "delete_volume" :: held 0.630s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Created reservations ['b0bb3cf1-765d-47b9-b228-55258e190a08', '052dd4d4-de2d-4746-8112-bbfe7c567c4b', 'b0c00cc1-356a-4e25-a953-d11644ec4b9d', '2af2ad4a-e16e-43bb-98ed-c984ef49c3dc'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:11 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:11 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:11 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Deleted volume successfully. Jul 20 16:57:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88c99e1b-b113-4e8e-a8fc-699d720ede2e tempest-VolumeDependencyTests-586003219 None] Lock "cinder-32f62bcd-2710-4465-bbdd-807c6e43b830-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Flow 'volume_create_manager' (b38cc5ef-4ff1-49d4-9c6e-884adaad8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae75bf3a-ac66-445f-b01c-23cf3561ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae75bf3a-ac66-445f-b01c-23cf3561ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d0375d-1bb6-4168-86c4-7b795062fba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0a13ac4af34864b58247ab41e701f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:14Z,use_quota=True,user_id='546831f6d020434d83d477be338f3e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2becc18b-1542-4b20-9715-f574bc4d7fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2becc18b-1542-4b20-9715-f574bc4d7fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33820fd9-d684-4fe9-89a1-fb8651096de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33820fd9-d684-4fe9-89a1-fb8651096de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d0375d-1bb6-4168-86c4-7b795062fba1', 'volume_name': 'volume-73d0375d-1bb6-4168-86c4-7b795062fba1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542877df-817d-4504-9d1b-bbc7ac06d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542877df-817d-4504-9d1b-bbc7ac06d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e76ae3-13be-400e-846a-663e62dc133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Volume 73d0375d-1bb6-4168-86c4-7b795062fba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d0375d-1bb6-4168-86c4-7b795062fba1', 'volume_size': 1} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d0375d-1bb6-4168-86c4-7b795062fba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0a13ac4af34864b58247ab41e701f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:14Z,use_quota=True,user_id='546831f6d020434d83d477be338f3e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Creating volume 73d0375d-1bb6-4168-86c4-7b795062fba1 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:14 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:14 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 1073741824 Jul 20 16:57:14 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:14 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 1073741824" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:14 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 Jul 20 16:57:14 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:15 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e76ae3-13be-400e-846a-663e62dc133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d0375d-1bb6-4168-86c4-7b795062fba1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c109ec6-e8d2-45bf-84c6-c9cebce2ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Volume volume-73d0375d-1bb6-4168-86c4-7b795062fba1 (73d0375d-1bb6-4168-86c4-7b795062fba1): created successfully Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c109ec6-e8d2-45bf-84c6-c9cebce2ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Flow 'volume_create_manager' (b38cc5ef-4ff1-49d4-9c6e-884adaad8397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-24a78cf8-ab7e-4324-b3f3-6c31deae25e6 tempest-CinderUnicodeTest-1689371613 None] Created volume successfully. Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Flow 'volume_create_manager' (eac8f603-8842-40ba-96e1-fbb71bb0dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543f2b51-3890-4eef-a6f3-257c20b1107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543f2b51-3890-4eef-a6f3-257c20b1107a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1404657666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811a19ac-25fb-4a8d-9f2d-6e10acf59e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0a13ac4af34864b58247ab41e701f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:16Z,use_quota=True,user_id='546831f6d020434d83d477be338f3e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0546a1-a187-4617-8ad1-105cb97a0f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0546a1-a187-4617-8ad1-105cb97a0f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b821edc-2c03-47cc-88e0-18ad42c183ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b821edc-2c03-47cc-88e0-18ad42c183ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811a19ac-25fb-4a8d-9f2d-6e10acf59e83', 'volume_name': 'volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553338cb-e93e-4252-997a-496548bc1f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553338cb-e93e-4252-997a-496548bc1f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b9bcce-b59c-4f89-95d8-26069fc4c73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Volume 811a19ac-25fb-4a8d-9f2d-6e10acf59e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83', 'volume_size': 1} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1404657666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811a19ac-25fb-4a8d-9f2d-6e10acf59e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0a13ac4af34864b58247ab41e701f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:16Z,use_quota=True,user_id='546831f6d020434d83d477be338f3e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Creating volume 811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:15 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:15 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 1073741824 Jul 20 16:57:15 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:16 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 1073741824" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:16 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 Jul 20 16:57:16 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:16 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b9bcce-b59c-4f89-95d8-26069fc4c73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7052eb-b68a-4b71-8554-8049f7538ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Volume volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 (811a19ac-25fb-4a8d-9f2d-6e10acf59e83): created successfully Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7052eb-b68a-4b71-8554-8049f7538ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Flow 'volume_create_manager' (eac8f603-8842-40ba-96e1-fbb71bb0dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a379d90c-9475-4ea8-afe7-b57795149a6a tempest-CinderUnicodeTest-1689371613 None] Created volume successfully. Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Creating offline snapshot ba097e11-b8f9-47f6-a377-bf8bcb4a1045 of volume 811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a54902-3141-4bc0-b51a-f79f070bb119]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:17 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 Jul 20 16:57:17 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:17 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:17 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 1G Jul 20 16:57:17 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:17 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 1G" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:17 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 Jul 20 16:57:17 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:18 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045" returned: 0 in 0.288s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:18 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 is being set with open permissions: ugo+rw Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:18 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 Jul 20 16:57:18 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:18 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:18 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info Jul 20 16:57:18 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:18 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info" returned: 0 in 0.237s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:18 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info is being set with open permissions: ugo+rw Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:18 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info Jul 20 16:57:18 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:18 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.info" returned: 0 in 0.245s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-72fdc56e-178a-4684-b2d3-e659c97a8356 tempest-CinderUnicodeTest-1689371613 None] Create snapshot completed successfully Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-ba097e11-b8f9-47f6-a377-bf8bcb4a1045-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-ba097e11-b8f9-47f6-a377-bf8bcb4a1045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-quobyte-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-quobyte-ba097e11-b8f9-47f6-a377-bf8bcb4a1045" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-ba097e11-b8f9-47f6-a377-bf8bcb4a1045" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Deleting offline snapshot ba097e11-b8f9-47f6-a377-bf8bcb4a1045 of volume 811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] snapshot_file for this snap is: volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f8e35-1437-494a-a809-9c416d62e734]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:19 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 Jul 20 16:57:19 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:19 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f2047d-e28b-4c54-9b7b-7844d6beb743]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:19 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 Jul 20 16:57:19 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:19 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" returned: 0 in 0.347s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:20 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 Jul 20 16:57:20 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:20 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045" returned: 0 in 0.319s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:20 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045 Jul 20 16:57:20 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:20 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83.ba097e11-b8f9-47f6-a377-bf8bcb4a1045" returned: 0 in 0.239s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-ba097e11-b8f9-47f6-a377-bf8bcb4a1045" released by "_delete_snapshot" :: held 1.351s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" released by "delete_snapshot" :: held 1.373s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Created reservations ['ddc7c6de-8194-437e-9932-e440f451ecef', '474966c3-07b3-4cc8-9248-49c2deb44794', '90079768-7157-4ac1-b6d8-1e9ffc3f4c01', '331fe562-cd05-4c4a-8b0d-a4da233b6625'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Delete snapshot completed successfully. Jul 20 16:57:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1bf06265-8001-44b0-b55d-dec0e76e8d12 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-ba097e11-b8f9-47f6-a377-bf8bcb4a1045-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-811a19ac-25fb-4a8d-9f2d-6e10acf59e83-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-811a19ac-25fb-4a8d-9f2d-6e10acf59e83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-quobyte-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" acquired by "delete_volume" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a511818e-8663-470f-ba98-5cde10fb1b35]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:21 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 Jul 20 16:57:21 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:21 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:21 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83 Jul 20 16:57:21 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:22 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" returned: 0 in 0.233s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-811a19ac-25fb-4a8d-9f2d-6e10acf59e83" released by "delete_volume" :: held 0.629s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Created reservations ['123e6007-3518-4073-b696-b5c173b55ec6', 'acd5b348-b9fe-48a7-afd4-b1411cb0fddf', 'cd4450ab-901b-487d-9c4e-5e505cd13818', 'f5f3ffd8-e19c-436e-9533-c17977f03e9c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:22 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:22 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:22 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.228s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Deleted volume successfully. Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2a319e5c-c862-4eda-86fa-7903cabf2864 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-811a19ac-25fb-4a8d-9f2d-6e10acf59e83-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-73d0375d-1bb6-4168-86c4-7b795062fba1-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-73d0375d-1bb6-4168-86c4-7b795062fba1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "cinder-quobyte-73d0375d-1bb6-4168-86c4-7b795062fba1" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-73d0375d-1bb6-4168-86c4-7b795062fba1" acquired by "delete_volume" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[83086063-f597-41e1-aedf-4c4fef21e74f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:22 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 Jul 20 16:57:22 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:22 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1" returned: 0 in 0.357s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:22 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1 Jul 20 16:57:22 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:23 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-73d0375d-1bb6-4168-86c4-7b795062fba1" returned: 0 in 0.235s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-quobyte-73d0375d-1bb6-4168-86c4-7b795062fba1" released by "delete_volume" :: held 0.634s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Created reservations ['1a71c0e5-6183-4edd-aa97-3e02348f4585', '84dc9243-f202-40a4-bae5-86492543afe9', 'fa0b4bb3-b7da-4e3e-9867-cfc7389ea67d', '04009a69-2d87-4f65-a917-8dfec81ffdb9'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:23 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:23 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:23 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.231s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:23 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Deleted volume successfully. Jul 20 16:57:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c4d9eada-9fca-46ac-9b95-5cd7a03f5393 tempest-CinderUnicodeTest-1689371613 None] Lock "cinder-73d0375d-1bb6-4168-86c4-7b795062fba1-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Flow 'volume_create_manager' (a335d667-449d-4b3e-bb7c-be9bdba73ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8891b9c-c661-4abd-8b1e-a94d41d54cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8891b9c-c661-4abd-8b1e-a94d41d54cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193213449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf66574-eb6d-426f-bbf6-3168fac31d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a94ec39dcf4e5686d3df35915250eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:27Z,use_quota=True,user_id='92970da195e2447bb4b1584ccfa923b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8714f4bf-2b23-49ce-bd05-71a53fefa8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8714f4bf-2b23-49ce-bd05-71a53fefa8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a435a07-1239-4a4b-8d41-036f8c40b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a435a07-1239-4a4b-8d41-036f8c40b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf66574-eb6d-426f-bbf6-3168fac31d24', 'volume_name': 'volume-ddf66574-eb6d-426f-bbf6-3168fac31d24', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbba5cce-78b6-4484-980d-58ea59f1cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbba5cce-78b6-4484-980d-58ea59f1cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37287084-9c58-483d-91a1-4f4da3dbb2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:26 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Volume ddf66574-eb6d-426f-bbf6-3168fac31d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf66574-eb6d-426f-bbf6-3168fac31d24', 'volume_size': 1} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1193213449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf66574-eb6d-426f-bbf6-3168fac31d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a94ec39dcf4e5686d3df35915250eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:27Z,use_quota=True,user_id='92970da195e2447bb4b1584ccfa923b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Creating volume ddf66574-eb6d-426f-bbf6-3168fac31d24 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:26 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:26 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 1073741824 Jul 20 16:57:26 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:27 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 1073741824" returned: 0 in 0.394s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:27 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 Jul 20 16:57:27 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:27 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24" returned: 0 in 0.236s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37287084-9c58-483d-91a1-4f4da3dbb2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf66574-eb6d-426f-bbf6-3168fac31d24', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37a7887-9916-442f-8eef-df78c7b9b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:27 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Volume volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 (ddf66574-eb6d-426f-bbf6-3168fac31d24): created successfully Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37a7887-9916-442f-8eef-df78c7b9b130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Flow 'volume_create_manager' (a335d667-449d-4b3e-bb7c-be9bdba73ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0c169fd6-f696-41af-8dd9-365c10cae09d tempest-ProjectReaderTests-336289074 None] Created volume successfully. Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Acquiring lock "cinder-ddf66574-eb6d-426f-bbf6-3168fac31d24-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Lock "cinder-ddf66574-eb6d-426f-bbf6-3168fac31d24-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Acquiring lock "cinder-quobyte-ddf66574-eb6d-426f-bbf6-3168fac31d24" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Lock "cinder-quobyte-ddf66574-eb6d-426f-bbf6-3168fac31d24" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce22f99-e92a-40fd-8652-87bb57200904]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:28 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 Jul 20 16:57:28 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:28 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24" returned: 0 in 0.351s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:28 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24 Jul 20 16:57:28 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:28 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ddf66574-eb6d-426f-bbf6-3168fac31d24" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Lock "cinder-quobyte-ddf66574-eb6d-426f-bbf6-3168fac31d24" released by "delete_volume" :: held 0.634s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Created reservations ['fe63f81e-666a-4c5a-871f-d316c8b7a3c0', 'c596f505-ae45-4436-b8d5-b71d6d720c74', '2fcf218b-e059-4b67-a2cd-c01e98912f56', '1752f3fa-1455-4b54-bc4c-1daa59414f8f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:28 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:28 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:28 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.239s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Deleted volume successfully. Jul 20 16:57:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5f9b83ca-de85-483b-8942-9ab515e97b56 tempest-ProjectReaderTests-336289074 None] Lock "cinder-ddf66574-eb6d-426f-bbf6-3168fac31d24-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Flow 'volume_create_manager' (cfcade83-32c8-4a08-a43c-0e25a1497c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50084a07-7284-4b8d-8da5-d456b2577d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50084a07-7284-4b8d-8da5-d456b2577d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910441261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc25191-71bf-4f78-bb87-21136b0cbf56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a94ec39dcf4e5686d3df35915250eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:29Z,use_quota=True,user_id='92970da195e2447bb4b1584ccfa923b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f9cc1-f170-4cdc-8086-c2da93dba882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f9cc1-f170-4cdc-8086-c2da93dba882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1197f3-ba08-4b66-8d23-867606cc99cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1197f3-ba08-4b66-8d23-867606cc99cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc25191-71bf-4f78-bb87-21136b0cbf56', 'volume_name': 'volume-5bc25191-71bf-4f78-bb87-21136b0cbf56', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0127f01d-76e3-45ab-93ca-77b499bc8f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0127f01d-76e3-45ab-93ca-77b499bc8f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bb3a86-f6f2-415a-b934-df903fb68d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Volume 5bc25191-71bf-4f78-bb87-21136b0cbf56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc25191-71bf-4f78-bb87-21136b0cbf56', 'volume_size': 1} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910441261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc25191-71bf-4f78-bb87-21136b0cbf56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a94ec39dcf4e5686d3df35915250eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:29Z,use_quota=True,user_id='92970da195e2447bb4b1584ccfa923b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Creating volume 5bc25191-71bf-4f78-bb87-21136b0cbf56 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:29 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:29 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 1073741824 Jul 20 16:57:29 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:29 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 1073741824" returned: 0 in 0.412s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:29 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 Jul 20 16:57:29 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:30 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bb3a86-f6f2-415a-b934-df903fb68d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc25191-71bf-4f78-bb87-21136b0cbf56', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69f7320-4919-4834-957b-bb090c43daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Volume volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 (5bc25191-71bf-4f78-bb87-21136b0cbf56): created successfully Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69f7320-4919-4834-957b-bb090c43daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Flow 'volume_create_manager' (cfcade83-32c8-4a08-a43c-0e25a1497c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-aea597ad-4d6f-4927-a004-0de793d292ea tempest-ProjectReaderTests-336289074 None] Created volume successfully. Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Acquiring lock "cinder-5bc25191-71bf-4f78-bb87-21136b0cbf56-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Lock "cinder-5bc25191-71bf-4f78-bb87-21136b0cbf56-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Acquiring lock "cinder-quobyte-5bc25191-71bf-4f78-bb87-21136b0cbf56" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Lock "cinder-quobyte-5bc25191-71bf-4f78-bb87-21136b0cbf56" acquired by "delete_volume" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ba2f8-d141-45b9-a315-c7cdfe981254]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:30 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 Jul 20 16:57:30 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:30 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:30 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56 Jul 20 16:57:30 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:31 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5bc25191-71bf-4f78-bb87-21136b0cbf56" returned: 0 in 0.238s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Lock "cinder-quobyte-5bc25191-71bf-4f78-bb87-21136b0cbf56" released by "delete_volume" :: held 0.617s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Created reservations ['086b4d8a-4475-4174-acb0-3101b946434a', 'd82580ef-804b-4ecb-8fe1-06b81e6db11b', '86b0e03c-a636-4320-b36a-e14b46ef0f4a', 'c682eadb-562e-474e-bb84-f16cdd8a4321'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:31 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:31 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:31 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Deleted volume successfully. Jul 20 16:57:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1e246a6-1339-4b9a-9022-cb3e2c13bd76 tempest-ProjectReaderTests-336289074 None] Lock "cinder-5bc25191-71bf-4f78-bb87-21136b0cbf56-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:34 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (4813c115-955b-489e-b13a-f52612816895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122cbb61-2996-4ed8-9c4d-5315aa389429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122cbb61-2996-4ed8-9c4d-5315aa389429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-683912685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba05052f-d041-4c3c-906f-9722354b673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:35Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510ab4d2-6889-4172-ad61-5320921a49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510ab4d2-6889-4172-ad61-5320921a49a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab2c4ec-6a2d-4874-a03e-a80473908b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab2c4ec-6a2d-4874-a03e-a80473908b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba05052f-d041-4c3c-906f-9722354b673c', 'volume_name': 'volume-ba05052f-d041-4c3c-906f-9722354b673c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa127809-0012-41b8-97ba-132b9f45501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa127809-0012-41b8-97ba-132b9f45501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e091db-2298-49cc-9d23-22beaf560407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:35 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Volume ba05052f-d041-4c3c-906f-9722354b673c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba05052f-d041-4c3c-906f-9722354b673c', 'volume_size': 1} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-683912685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba05052f-d041-4c3c-906f-9722354b673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:35Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Creating volume ba05052f-d041-4c3c-906f-9722354b673c {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:35 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:35 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c 1073741824 Jul 20 16:57:35 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:35 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c 1073741824" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:35 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c Jul 20 16:57:35 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:35 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e091db-2298-49cc-9d23-22beaf560407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba05052f-d041-4c3c-906f-9722354b673c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcac1ea-fe4a-45f8-b290-09a21eed5660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:35 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Volume volume-ba05052f-d041-4c3c-906f-9722354b673c (ba05052f-d041-4c3c-906f-9722354b673c): created successfully Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcac1ea-fe4a-45f8-b290-09a21eed5660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (4813c115-955b-489e-b13a-f52612816895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f9c71b1d-5339-476e-8483-ddd9c6aa1ec6 tempest-ProjectReaderTests-201592513 None] Created volume successfully. Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-ba05052f-d041-4c3c-906f-9722354b673c-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Lock "cinder-ba05052f-d041-4c3c-906f-9722354b673c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-quobyte-ba05052f-d041-4c3c-906f-9722354b673c" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-ba05052f-d041-4c3c-906f-9722354b673c" acquired by "delete_volume" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a698200-b4c8-4371-997d-2e975b3b13e3]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:36 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c Jul 20 16:57:36 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:36 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c" returned: 0 in 0.347s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:36 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c Jul 20 16:57:36 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:36 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ba05052f-d041-4c3c-906f-9722354b673c" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-ba05052f-d041-4c3c-906f-9722354b673c" released by "delete_volume" :: held 0.624s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Created reservations ['94a21610-2001-4527-97db-3f9ab23c9d0e', '4521e886-1626-4fe2-a4a3-7a6c52bc1401', 'c1d25982-fd8a-458e-b70f-fafa38c548fa', 'e38bd693-5d01-4553-b1c3-9937a43267fc'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:36 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:36 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:37 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.241s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:37 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Deleted volume successfully. Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c7556698-2eee-4166-a9f1-e2cab2d27698 tempest-ProjectReaderTests-201592513 None] Lock "cinder-ba05052f-d041-4c3c-906f-9722354b673c-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (33362a49-3982-4866-9cf9-871899222907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e7f263-1b84-43c9-b2d9-9902094c06e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e7f263-1b84-43c9-b2d9-9902094c06e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220748383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2984abb4-6234-43ff-9d31-c748e15a6692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:38Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec23a5da-fdd8-4810-82db-c1da17f6f889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec23a5da-fdd8-4810-82db-c1da17f6f889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b364579a-1d1d-4b60-af10-2711b6440e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b364579a-1d1d-4b60-af10-2711b6440e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2984abb4-6234-43ff-9d31-c748e15a6692', 'volume_name': 'volume-2984abb4-6234-43ff-9d31-c748e15a6692', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29dc6da9-f4a5-4f14-9304-9256c23eec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29dc6da9-f4a5-4f14-9304-9256c23eec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d411260-ae2d-4071-9d53-acc9beb03c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:37 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Volume 2984abb4-6234-43ff-9d31-c748e15a6692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2984abb4-6234-43ff-9d31-c748e15a6692', 'volume_size': 1} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220748383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2984abb4-6234-43ff-9d31-c748e15a6692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:38Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Creating volume 2984abb4-6234-43ff-9d31-c748e15a6692 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:37 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:37 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 1073741824 Jul 20 16:57:37 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:38 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 1073741824" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:38 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 Jul 20 16:57:38 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:38 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d411260-ae2d-4071-9d53-acc9beb03c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2984abb4-6234-43ff-9d31-c748e15a6692', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881b8ac0-f340-4d4c-8979-56127504a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:38 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Volume volume-2984abb4-6234-43ff-9d31-c748e15a6692 (2984abb4-6234-43ff-9d31-c748e15a6692): created successfully Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881b8ac0-f340-4d4c-8979-56127504a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (33362a49-3982-4866-9cf9-871899222907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:38 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c205725f-1b54-433d-af5f-8b47e90db652 tempest-ProjectReaderTests-201592513 None] Created volume successfully. Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-2984abb4-6234-43ff-9d31-c748e15a6692-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Lock "cinder-2984abb4-6234-43ff-9d31-c748e15a6692-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-quobyte-2984abb4-6234-43ff-9d31-c748e15a6692" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-2984abb4-6234-43ff-9d31-c748e15a6692" acquired by "delete_volume" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e3946-4b24-468f-b8f0-a2074049c10e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:38 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 Jul 20 16:57:38 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:39 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:39 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:39 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692" returned: 0 in 0.347s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:39 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692 Jul 20 16:57:39 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:39 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:57:39 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2984abb4-6234-43ff-9d31-c748e15a6692" returned: 0 in 0.244s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-2984abb4-6234-43ff-9d31-c748e15a6692" released by "delete_volume" :: held 0.628s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Created reservations ['0fdfa58c-efb5-40f6-80c1-3d8ddbbe3bff', 'dc9f1fe6-aa87-4c05-b52d-649e4b45c39e', '33a96251-0e81-4a54-9c04-e8e3b4d46a57', '407375f3-f893-4f3e-b5f0-33be9d75d305'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:39 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:39 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:39 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.253s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Deleted volume successfully. Jul 20 16:57:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-32c66b4b-fc63-4da2-8b93-9c79e1dc54ae tempest-ProjectReaderTests-201592513 None] Lock "cinder-2984abb4-6234-43ff-9d31-c748e15a6692-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (5284ef89-bd60-4b40-86d6-2e16fb07b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26c5cc-dac9-4486-805a-f87d17394d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26c5cc-dac9-4486-805a-f87d17394d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116115407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd50e155-bfe4-4b7a-9bc1-d88711aa5308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:40Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ada897-3e48-409b-9349-efb8acac0e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ada897-3e48-409b-9349-efb8acac0e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f5fcfd-6268-4e05-b2fe-3d372375c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f5fcfd-6268-4e05-b2fe-3d372375c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd50e155-bfe4-4b7a-9bc1-d88711aa5308', 'volume_name': 'volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c48967-96e2-4521-8a13-ee13b35b0f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c48967-96e2-4521-8a13-ee13b35b0f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc4624c-94bb-4a42-9dd0-1f63924bea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:40 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Volume dd50e155-bfe4-4b7a-9bc1-d88711aa5308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308', 'volume_size': 1} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116115407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd50e155-bfe4-4b7a-9bc1-d88711aa5308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:40Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Creating volume dd50e155-bfe4-4b7a-9bc1-d88711aa5308 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:40 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:40 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 1073741824 Jul 20 16:57:40 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:40 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 1073741824" returned: 0 in 0.403s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:40 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 Jul 20 16:57:40 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:41 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308" returned: 0 in 0.235s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc4624c-94bb-4a42-9dd0-1f63924bea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35e1988-741c-416d-ab3d-89096a7aa13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:41 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Volume volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 (dd50e155-bfe4-4b7a-9bc1-d88711aa5308): created successfully Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35e1988-741c-416d-ab3d-89096a7aa13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (5284ef89-bd60-4b40-86d6-2e16fb07b482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-db1f681e-7722-4583-87dc-e58a6aa4959c tempest-ProjectReaderTests-201592513 None] Created volume successfully. Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-dd50e155-bfe4-4b7a-9bc1-d88711aa5308-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Lock "cinder-dd50e155-bfe4-4b7a-9bc1-d88711aa5308-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-quobyte-dd50e155-bfe4-4b7a-9bc1-d88711aa5308" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-dd50e155-bfe4-4b7a-9bc1-d88711aa5308" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9129dd76-c463-464a-9f38-47a65967a728]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:41 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 Jul 20 16:57:41 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:41 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308" returned: 0 in 0.341s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:41 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308 Jul 20 16:57:41 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:42 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-dd50e155-bfe4-4b7a-9bc1-d88711aa5308" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-dd50e155-bfe4-4b7a-9bc1-d88711aa5308" released by "delete_volume" :: held 0.625s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Created reservations ['f14eca0e-46b2-41ee-ad87-c9b15b17868f', '5993b3cb-8e7e-42ae-ac0b-24700582fe45', '373d90ed-fb13-444c-85a4-bfef4271dda5', 'a3795362-578e-4b19-8285-9e1f51aeda27'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:42 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:42 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:42 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Deleted volume successfully. Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-6352b279-2bdf-4e16-ba0a-8fcc1835a72c tempest-ProjectReaderTests-201592513 None] Lock "cinder-dd50e155-bfe4-4b7a-9bc1-d88711aa5308-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (89fb7927-6602-4eec-a5c7-897115442a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48a2ab1-1a17-45e4-a644-288b6e7b9797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48a2ab1-1a17-45e4-a644-288b6e7b9797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-133903554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db212eb3-0b9d-4238-a56c-106bfa3059dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:43Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac3c458-2e3a-4cd5-8a76-8fd0d7b0eb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac3c458-2e3a-4cd5-8a76-8fd0d7b0eb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913e60c4-2943-4f1e-8ce1-c38a125e415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913e60c4-2943-4f1e-8ce1-c38a125e415c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db212eb3-0b9d-4238-a56c-106bfa3059dd', 'volume_name': 'volume-db212eb3-0b9d-4238-a56c-106bfa3059dd', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24080f73-fe4d-4f5c-a9bc-aa2ef6d1e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24080f73-fe4d-4f5c-a9bc-aa2ef6d1e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd86f289-be49-4cf1-97b4-98dbe37aab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:43 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Volume db212eb3-0b9d-4238-a56c-106bfa3059dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db212eb3-0b9d-4238-a56c-106bfa3059dd', 'volume_size': 1} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-133903554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db212eb3-0b9d-4238-a56c-106bfa3059dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c64d1847a094a51be329d3f3ba8ea3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:43Z,use_quota=True,user_id='fdc500f9e1694d8e87bd802ed11b27d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Creating volume db212eb3-0b9d-4238-a56c-106bfa3059dd {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:43 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:43 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd 1073741824 Jul 20 16:57:43 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:43 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd 1073741824" returned: 0 in 0.405s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=89,cinder:UPDATE=128,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=114,cinder:DELETE=12 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:43 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd Jul 20 16:57:43 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:43 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd" returned: 0 in 0.234s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd86f289-be49-4cf1-97b4-98dbe37aab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db212eb3-0b9d-4238-a56c-106bfa3059dd', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b871357-e98e-4e5d-a4e6-4a4ae293add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:43 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Volume volume-db212eb3-0b9d-4238-a56c-106bfa3059dd (db212eb3-0b9d-4238-a56c-106bfa3059dd): created successfully Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b871357-e98e-4e5d-a4e6-4a4ae293add1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Flow 'volume_create_manager' (89fb7927-6602-4eec-a5c7-897115442a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:43 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-94f15910-7fb2-466e-8e7d-31568c78624d tempest-ProjectReaderTests-201592513 None] Created volume successfully. Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-db212eb3-0b9d-4238-a56c-106bfa3059dd-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Lock "cinder-db212eb3-0b9d-4238-a56c-106bfa3059dd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Acquiring lock "cinder-quobyte-db212eb3-0b9d-4238-a56c-106bfa3059dd" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-db212eb3-0b9d-4238-a56c-106bfa3059dd" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3de9c6-0cb3-4073-8788-513ed7ff79d1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:44 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd Jul 20 16:57:44 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:44 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd" returned: 0 in 0.350s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:44 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd Jul 20 16:57:44 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:44 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-db212eb3-0b9d-4238-a56c-106bfa3059dd" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Lock "cinder-quobyte-db212eb3-0b9d-4238-a56c-106bfa3059dd" released by "delete_volume" :: held 0.631s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Created reservations ['c8f75121-1dcf-4b77-939f-ad2bf5195421', 'cf7f0a75-ab70-4e70-a28f-b972559aa052', '6b0788f8-68be-4807-b194-fc7bf586bcee', '17755e09-e7bc-46c8-8c8e-752a3b45f26c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:44 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:57:44 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:45 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.252s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:45 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:57:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Deleted volume successfully. Jul 20 16:57:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e395ccad-2cc1-490b-8e46-fae2067ca9e3 tempest-ProjectReaderTests-201592513 None] Lock "cinder-db212eb3-0b9d-4238-a56c-106bfa3059dd-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (bbc815e4-f7c5-48c4-932b-bd224fac7556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d57b6f-68f8-411a-b126-0f224a3c5f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d57b6f-68f8-411a-b126-0f224a3c5f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625585072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f7384f-1694-45c4-b85f-0c1935676edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:57Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8daf46ea-a58c-4545-bb5b-74886157868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8daf46ea-a58c-4545-bb5b-74886157868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd19486-c29e-4260-82f3-f4219b3b62cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd19486-c29e-4260-82f3-f4219b3b62cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f7384f-1694-45c4-b85f-0c1935676edc', 'volume_name': 'volume-61f7384f-1694-45c4-b85f-0c1935676edc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d56e87-7582-400b-884f-6f9852e58cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d56e87-7582-400b-884f-6f9852e58cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be638cc-3a87-4e3d-96e6-b4972a3898b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume 61f7384f-1694-45c4-b85f-0c1935676edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f7384f-1694-45c4-b85f-0c1935676edc', 'volume_size': 1} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625585072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f7384f-1694-45c4-b85f-0c1935676edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:57Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating volume 61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:56 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:56 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc 1073741824 Jul 20 16:57:56 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (468ea84c-3c4b-4ff1-a6f0-2f03010f215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cef5d14-5c4f-4d7a-8146-799e16f594de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cef5d14-5c4f-4d7a-8146-799e16f594de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145195887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe198fa0-a450-4016-a773-f00680671aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:57Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca139da-7d6b-4fe9-b508-ded56d370c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca139da-7d6b-4fe9-b508-ded56d370c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672b1906-e71d-496a-83a3-d2d6b81c5e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672b1906-e71d-496a-83a3-d2d6b81c5e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe198fa0-a450-4016-a773-f00680671aa5', 'volume_name': 'volume-fe198fa0-a450-4016-a773-f00680671aa5', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f78cc-5fc7-4767-91b3-f2dabf55c7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f78cc-5fc7-4767-91b3-f2dabf55c7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e00de11-522f-4d7e-8dbc-46879a559ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume fe198fa0-a450-4016-a773-f00680671aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe198fa0-a450-4016-a773-f00680671aa5', 'volume_size': 1} Jul 20 16:57:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (94b5ce23-6fcd-4eea-872a-fcce94e92048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a87828-2428-45bf-9bae-d0ebc9987236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a87828-2428-45bf-9bae-d0ebc9987236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-255910616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:57Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5405196-f7fa-4ff1-920b-fb0950645055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5405196-f7fa-4ff1-920b-fb0950645055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb63618-5878-49fd-9f9d-a59e69c01594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb63618-5878-49fd-9f9d-a59e69c01594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb', 'volume_name': 'volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb31b55e-b38e-4fcb-b91c-1e4f2c779ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb31b55e-b38e-4fcb-b91c-1e4f2c779ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fc7067-e3a0-4aec-8107-e104c406316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Volume 4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb', 'volume_size': 1} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:57 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc 1073741824" returned: 0 in 0.576s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:57 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc Jul 20 16:57:57 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (3afe53ae-e292-4a81-b9fd-17fe79863a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693008cc-5b5a-4619-b1ab-fcf94d8f0d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693008cc-5b5a-4619-b1ab-fcf94d8f0d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315642439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c010fbb-325e-4d88-a5fe-ffa19f52f7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:58Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058d3603-b92b-4dd2-afc8-54057db446ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058d3603-b92b-4dd2-afc8-54057db446ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95edc3-f443-4400-a2b3-6fd7cd7ae3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc95edc3-f443-4400-a2b3-6fd7cd7ae3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c010fbb-325e-4d88-a5fe-ffa19f52f7b8', 'volume_name': 'volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470da343-feb7-4c84-a3e0-de4ef073fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470da343-feb7-4c84-a3e0-de4ef073fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428119c4-3880-49ae-923d-16dca31e0489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Volume 1c010fbb-325e-4d88-a5fe-ffa19f52f7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8', 'volume_size': 1} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc" returned: 0 in 0.338s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-145195887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe198fa0-a450-4016-a773-f00680671aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:57Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Creating volume fe198fa0-a450-4016-a773-f00680671aa5 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:57 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:57 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 1073741824 Jul 20 16:57:57 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be638cc-3a87-4e3d-96e6-b4972a3898b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f7384f-1694-45c4-b85f-0c1935676edc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5487e646-d072-4a12-9aef-a4d279ea9d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:57 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume volume-61f7384f-1694-45c4-b85f-0c1935676edc (61f7384f-1694-45c4-b85f-0c1935676edc): created successfully Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5487e646-d072-4a12-9aef-a4d279ea9d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (bbc815e4-f7c5-48c4-932b-bd224fac7556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:57 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f1d4b56a-8035-4d98-92dc-e0112fe370fa tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created volume successfully. Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (da3e9409-f3fe-4276-b43b-a971ab8665a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3d32bf-8ef2-40e3-9774-2bd125d3e95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3d32bf-8ef2-40e3-9774-2bd125d3e95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281119609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c826121f-9cef-4182-a97f-98eb6ba41367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:58Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cc87a9-1516-4803-9d90-3eca177c2f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cc87a9-1516-4803-9d90-3eca177c2f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bef5d91-ff6d-42ea-affd-b2284046b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bef5d91-ff6d-42ea-affd-b2284046b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c826121f-9cef-4182-a97f-98eb6ba41367', 'volume_name': 'volume-c826121f-9cef-4182-a97f-98eb6ba41367', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b4d04a-b6dc-4f6d-9500-6bff51386caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b4d04a-b6dc-4f6d-9500-6bff51386caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d50e24-78af-419a-9f19-e53b1f5df042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Volume c826121f-9cef-4182-a97f-98eb6ba41367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c826121f-9cef-4182-a97f-98eb6ba41367', 'volume_size': 1} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:58 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 1073741824" returned: 0 in 0.558s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:58 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 Jul 20 16:57:58 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (cfc868d1-44b4-419a-8779-47c5229c2d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5309c2a-3e46-43c5-9970-db80d21c2ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5309c2a-3e46-43c5-9970-db80d21c2ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1173422651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b8eb49-7f09-4e6d-9fea-4fea686b4f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:58Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de71346-1a06-4633-8d7c-86518bbdc456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de71346-1a06-4633-8d7c-86518bbdc456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98598860-de67-45df-89fa-decafe349b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98598860-de67-45df-89fa-decafe349b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b8eb49-7f09-4e6d-9fea-4fea686b4f68', 'volume_name': 'volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e350d02f-06fd-4189-9c88-1bf7ecb42e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e350d02f-06fd-4189-9c88-1bf7ecb42e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0c4996-3959-49da-901a-66d66d980d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Volume e3b8eb49-7f09-4e6d-9fea-4fea686b4f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68', 'volume_size': 1} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:58 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-255910616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:57Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Creating volume 4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:58 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:58 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb 1073741824 Jul 20 16:57:58 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e00de11-522f-4d7e-8dbc-46879a559ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe198fa0-a450-4016-a773-f00680671aa5', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec1b77a-2620-47db-a299-5a8b6e0e6362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:58 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume volume-fe198fa0-a450-4016-a773-f00680671aa5 (fe198fa0-a450-4016-a773-f00680671aa5): created successfully Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec1b77a-2620-47db-a299-5a8b6e0e6362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (468ea84c-3c4b-4ff1-a6f0-2f03010f215f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:58 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-09c0c3a3-c18c-43bc-aa6d-b9559e788023 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created volume successfully. Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (66c57868-934b-4f88-a113-d6ceef717bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4bd1a1-721c-4bac-83e4-10924772a9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4bd1a1-721c-4bac-83e4-10924772a9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-895537017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e9973e-ac1c-4343-adab-c4c3d44fdc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:59Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6166dfc7-ba90-4ae7-ac77-a6d929cc5c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6166dfc7-ba90-4ae7-ac77-a6d929cc5c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9888c9f6-ae0b-4934-94e3-ecb1c8e93c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9888c9f6-ae0b-4934-94e3-ecb1c8e93c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e9973e-ac1c-4343-adab-c4c3d44fdc4e', 'volume_name': 'volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5337e4-e03a-477d-b602-f8c27893991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5337e4-e03a-477d-b602-f8c27893991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4804445-e5b9-4ca5-8e7d-570f603c6b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Volume 84e9973e-ac1c-4343-adab-c4c3d44fdc4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e', 'volume_size': 1} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:59 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb 1073741824" returned: 0 in 0.545s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:59 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb Jul 20 16:57:59 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:59 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb" returned: 0 in 0.240s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315642439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c010fbb-325e-4d88-a5fe-ffa19f52f7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:58Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Creating volume 1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:57:59 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fc7067-e3a0-4aec-8107-e104c406316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea35e4cb-9cf1-486b-bc63-ab588f00400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:57:59 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 1073741824 Jul 20 16:57:59 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:57:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Volume volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb (4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb): created successfully Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea35e4cb-9cf1-486b-bc63-ab588f00400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:57:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (94b5ce23-6fcd-4eea-872a-fcce94e92048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:57:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d591aa6e-ff91-46b8-b17b-6ed9985c483f tempest-CreateVolumesFromImageTest-142834257 None] Created volume successfully. Jul 20 16:58:00 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 1073741824" returned: 0 in 0.581s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:00 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 Jul 20 16:58:00 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (a69538ac-339f-446a-9cbc-aab3b5eedd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcafd79-68a6-47b8-8f97-2e0da2be0632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcafd79-68a6-47b8-8f97-2e0da2be0632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237465911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b6e403-1987-4b08-9691-2f08ff6b8dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:00Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b8106e-5ecb-4d76-b3f7-fa821c5d12d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b8106e-5ecb-4d76-b3f7-fa821c5d12d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a8ca1c-3e76-4033-ac1c-67782cb9724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a8ca1c-3e76-4033-ac1c-67782cb9724c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b6e403-1987-4b08-9691-2f08ff6b8dbc', 'volume_name': 'volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ce6838-3979-408c-a05d-b8a245aef5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ce6838-3979-408c-a05d-b8a245aef5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5f7190-133d-492c-b3de-10a53fca9b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume 07b6e403-1987-4b08-9691-2f08ff6b8dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc', 'volume_size': 1} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:00 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.292s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281119609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c826121f-9cef-4182-a97f-98eb6ba41367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:58Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Creating volume c826121f-9cef-4182-a97f-98eb6ba41367 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:00 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428119c4-3880-49ae-923d-16dca31e0489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 1073741824 Jul 20 16:58:00 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaff9f3-28c2-402c-8081-ecca9eb23868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Volume volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 (1c010fbb-325e-4d88-a5fe-ffa19f52f7b8): created successfully Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaff9f3-28c2-402c-8081-ecca9eb23868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (3afe53ae-e292-4a81-b9fd-17fe79863a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-67fdb347-cc0d-47a0-9666-bd3738f3a617 tempest-CreateVolumesFromImageTest-142834257 None] Created volume successfully. Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Flow 'volume_create_manager' (919cdac9-a4b2-415c-8faf-9b83c036121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ad454-5af2-4bde-b98c-ffb72bd270b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ad454-5af2-4bde-b98c-ffb72bd270b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e8490e-4e65-4dfd-af52-2808b2457679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd23d380784c04b30e7eec2b4ab4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:01Z,use_quota=True,user_id='9a3df1b6845c4b21b839880357cf16ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2d71ec-fbe5-4d11-8c29-936428296ca8),volume_type_id=6c2d71ec-fbe5-4d11-8c29-936428296ca8)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b509bd-c924-4d40-8747-e86a9d43f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b509bd-c924-4d40-8747-e86a9d43f178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37103fe0-9551-41d7-a502-b262db319b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:00 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (cde32412-e1d3-4501-a85f-8c6e9b486d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb94223-467f-4dfa-bfdf-094b160e9289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb94223-467f-4dfa-bfdf-094b160e9289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1885369425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf28929-d393-45d9-8ee2-cc418c9ecdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:01Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123c0cda-1d69-4dbc-a39e-4c98001a111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123c0cda-1d69-4dbc-a39e-4c98001a111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c69370e-a275-4caa-9fda-c6ac54130f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c69370e-a275-4caa-9fda-c6ac54130f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf28929-d393-45d9-8ee2-cc418c9ecdf7', 'volume_name': 'volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58445a7c-924e-4746-b13f-d287b72e61fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58445a7c-924e-4746-b13f-d287b72e61fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7ee9e5-ff38-4775-a19e-27148ed76a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume 3cf28929-d393-45d9-8ee2-cc418c9ecdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7', 'volume_size': 1} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:01 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 1073741824" returned: 0 in 0.641s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:01 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 Jul 20 16:58:01 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37103fe0-9551-41d7-a502-b262db319b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3e8490e-4e65-4dfd-af52-2808b2457679', 'volume_name': 'volume-a3e8490e-4e65-4dfd-af52-2808b2457679', 'volume_size': 1, 'image_id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5001f17a7ad9dc1126f2fab4922d8443', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ffd23d380784c04b30e7eec2b4ab4d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9eaa7039ffaee374d94d247b89e4a8c418aab53c73ca5e21b58520eec5e68f8f29bde5ae5ee0d5dc9838a82756600d09c9789de6ae64666d34d439ec427d5157', 'id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'created_at': datetime.datetime(2026, 7, 20, 14, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade40643-f588-467e-a94f-04aa3c9b28c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade40643-f588-467e-a94f-04aa3c9b28c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e8374d-9607-41e1-b308-8a42f162d080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Volume a3e8490e-4e65-4dfd-af52-2808b2457679: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3e8490e-4e65-4dfd-af52-2808b2457679', 'volume_size': 1, 'image_id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5001f17a7ad9dc1126f2fab4922d8443', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ffd23d380784c04b30e7eec2b4ab4d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9eaa7039ffaee374d94d247b89e4a8c418aab53c73ca5e21b58520eec5e68f8f29bde5ae5ee0d5dc9838a82756600d09c9789de6ae64666d34d439ec427d5157', 'id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'created_at': datetime.datetime(2026, 7, 20, 14, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Trying to clone a3e8490e-4e65-4dfd-af52-2808b2457679 from image 26bafb98-eae2-4221-8d4c-7ad0e21073fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (960155be-8996-4fa7-8dfd-a84d6fff4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700e9055-2a1b-47c6-97da-e16b8f724591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Image download 0.00 MB at 0.00 MB/s Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700e9055-2a1b-47c6-97da-e16b8f724591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048332445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093698f6-ae34-4ecb-906a-19e5003b9844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:01Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db717e-fd0c-4640-9b9f-5429c38a23d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01db717e-fd0c-4640-9b9f-5429c38a23d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c591a8f-f7f0-45a4-82dc-b8b618cf9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c591a8f-f7f0-45a4-82dc-b8b618cf9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093698f6-ae34-4ecb-906a-19e5003b9844', 'volume_name': 'volume-093698f6-ae34-4ecb-906a-19e5003b9844', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681f8f6b-4ebd-44e8-810d-e304082af780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681f8f6b-4ebd-44e8-810d-e304082af780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73762510-5148-4aac-8403-5a3a3c5c5a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume 093698f6-ae34-4ecb-906a-19e5003b9844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093698f6-ae34-4ecb-906a-19e5003b9844', 'volume_size': 1} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bd7033-fe80-4147-8990-6b739954f5bf]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:01 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367" returned: 0 in 0.394s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.078s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1173422651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b8eb49-7f09-4e6d-9fea-4fea686b4f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:58Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Creating volume e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:01 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD Jul 20 16:58:01 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:01 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 1073741824 Jul 20 16:58:01 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d50e24-78af-419a-9f19-e53b1f5df042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c826121f-9cef-4182-a97f-98eb6ba41367', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42c8699-d4dc-4619-ab3c-8369154272b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Volume volume-c826121f-9cef-4182-a97f-98eb6ba41367 (c826121f-9cef-4182-a97f-98eb6ba41367): created successfully Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42c8699-d4dc-4619-ab3c-8369154272b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (da3e9409-f3fe-4276-b43b-a971ab8665a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:01 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5b2d12ba-32c3-4e70-832a-a515858321b8 tempest-CreateVolumesFromImageTest-142834257 None] Created volume successfully. Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:01 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (aa11f5a3-bf3f-4ee3-b949-6da0115d6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90df4b08-5a9e-47f6-aadb-e719dedfea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90df4b08-5a9e-47f6-aadb-e719dedfea21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034812898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6978a7-ee39-4a56-a37f-8f87bc383d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:02Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab46e37-83a9-4e51-943c-6913d336baff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab46e37-83a9-4e51-943c-6913d336baff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f58a16-2135-490c-b4bc-2144f7dfa6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f58a16-2135-490c-b4bc-2144f7dfa6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6978a7-ee39-4a56-a37f-8f87bc383d2c', 'volume_name': 'volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2a72ad-e70b-4a73-a57a-e94b0a7cdeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2a72ad-e70b-4a73-a57a-e94b0a7cdeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6f0f63-9578-4c57-a091-736d079fc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume 2e6978a7-ee39-4a56-a37f-8f87bc383d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c', 'volume_size': 1} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:02 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:02 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD Jul 20 16:58:02 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:02 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 1073741824" returned: 0 in 0.531s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (bd63a3f0-1404-4b37-9dfc-e062965c151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b17bcd-0367-401d-afaa-315b14522a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:02 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b17bcd-0367-401d-afaa-315b14522a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331166538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:02Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b699affb-4621-4bfa-be3c-ca22e84b6e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b699affb-4621-4bfa-be3c-ca22e84b6e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff40697-1b38-4b39-8efc-0dc4c0a04698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff40697-1b38-4b39-8efc-0dc4c0a04698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73', 'volume_name': 'volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa18ba3-9dc7-43bd-9bff-c92efc07e4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa18ba3-9dc7-43bd-9bff-c92efc07e4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786b7e84-e6e4-4b6b-b2e3-32e7ce466efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73', 'volume_size': 1} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:02 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Temporary image 26bafb98-eae2-4221-8d4c-7ad0e21073fd is fetched for user 9a3df1b6845c4b21b839880357cf16ea. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c7b19-7302-4142-ba0f-e4d030aeea88]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:02 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.481s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating offline snapshot f920d246-42fc-40ee-8c6b-54eb2099019c of volume 61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0c4996-3959-49da-901a-66d66d980d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD Jul 20 16:58:02 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6755d6d0-d6c1-49e5-8057-86f039f799ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a00ca7-7f98-4231-8dc3-04d38df3d4ff]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Volume volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 (e3b8eb49-7f09-4e6d-9fea-4fea686b4f68): created successfully Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6755d6d0-d6c1-49e5-8057-86f039f799ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (cfc868d1-44b4-419a-8779-47c5229c2d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:02 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5eaad08c-8190-4f17-b9ea-8f1a01b7429d tempest-CreateVolumesFromImageTest-142834257 None] Created volume successfully. Jul 20 16:58:02 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc Jul 20 16:58:02 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:02 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:02 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD Jul 20 16:58:02 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:03 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:03 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c 1G Jul 20 16:58:03 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:03 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:03 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c 1G" returned: 0 in 0.397s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f7384f-1694-45c4-b85f-0c1935676edc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:03 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f7384f-1694-45c4-b85f-0c1935676edc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c Jul 20 16:58:03 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:03 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f7384f-1694-45c4-b85f-0c1935676edc -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c" returned: 0 in 0.293s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:03 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c is being set with open permissions: ugo+rw Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:03 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c Jul 20 16:58:03 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:03 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c" returned: 0 in 0.239s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:04 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info Jul 20 16:58:04 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:04 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:04 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info is being set with open permissions: ugo+rw Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:04 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info Jul 20 16:58:04 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:04 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.info" returned: 0 in 0.241s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.258s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-895537017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e9973e-ac1c-4343-adab-c4c3d44fdc4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26482b0f064c4226b8c2d8d874a6a378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:57:59Z,use_quota=True,user_id='79681d4932c147a3b93238228f82e7fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Creating volume 84e9973e-ac1c-4343-adab-c4c3d44fdc4e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:04 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:04 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e 1073741824 Jul 20 16:58:04 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-91b97fad-04b3-4529-b2f0-30a2d0bcb455 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Create snapshot completed successfully Jul 20 16:58:04 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e 1073741824" returned: 0 in 0.402s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:05 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e Jul 20 16:58:05 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:05 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e" returned: 0 in 0.242s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.758s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237465911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b6e403-1987-4b08-9691-2f08ff6b8dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:00Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Creating volume 07b6e403-1987-4b08-9691-2f08ff6b8dbc {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:05 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4804445-e5b9-4ca5-8e7d-570f603c6b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:05 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc 1073741824 Jul 20 16:58:05 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a7a3ef-911f-47e3-90cc-302b88b40f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Volume volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e (84e9973e-ac1c-4343-adab-c4c3d44fdc4e): created successfully Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a7a3ef-911f-47e3-90cc-302b88b40f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Flow 'volume_create_manager' (66c57868-934b-4f88-a113-d6ceef717bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6944eb38-c3da-464a-b6a1-21725d869f7e tempest-CreateVolumesFromImageTest-142834257 None] Created volume successfully. Jul 20 16:58:05 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc 1073741824" returned: 0 in 0.427s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:05 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc Jul 20 16:58:05 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (60a62e14-836e-4a46-92e4-b83006716577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456f02a-db5e-406b-aa1c-5664418bae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456f02a-db5e-406b-aa1c-5664418bae00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047656900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4477ea6b-e6b2-4eb8-b123-482d6864ac49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:06Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a989da00-5b10-4af4-bd47-f021227ed1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a989da00-5b10-4af4-bd47-f021227ed1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3218e2-5a82-4b6c-9e8d-264e07bce809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3218e2-5a82-4b6c-9e8d-264e07bce809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4477ea6b-e6b2-4eb8-b123-482d6864ac49', 'volume_name': 'volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffea41d-1ffa-42a9-a323-02e91d15247a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffea41d-1ffa-42a9-a323-02e91d15247a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea680f0-c11f-4727-8555-f769b541b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:05 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume 4477ea6b-e6b2-4eb8-b123-482d6864ac49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49', 'volume_size': 1} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:05 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.754s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1885369425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf28929-d393-45d9-8ee2-cc418c9ecdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:01Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Creating volume 3cf28929-d393-45d9-8ee2-cc418c9ecdf7 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:05 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5f7190-133d-492c-b3de-10a53fca9b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f4d5fc-e6d4-4ad6-9017-fc54d54652dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 1073741824 Jul 20 16:58:06 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc (07b6e403-1987-4b08-9691-2f08ff6b8dbc): created successfully Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f4d5fc-e6d4-4ad6-9017-fc54d54652dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (a69538ac-339f-446a-9cbc-aab3b5eedd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f40ed1af-8b25-45d2-a95c-a5b94860ae55 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created volume successfully. Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (2e504d3f-6b5b-4568-86b9-e07817a24f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689b1da5-d28c-4082-a5c4-e5251205bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-84e9973e-ac1c-4343-adab-c4c3d44fdc4e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689b1da5-d28c-4082-a5c4-e5251205bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59433655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f60bf5-8df2-4ba4-b524-49c13a1fd1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:06Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a2730-da0d-4db9-8e88-c5046339434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a2730-da0d-4db9-8e88-c5046339434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8159c583-7dc2-41bb-814b-d612e2d718de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8159c583-7dc2-41bb-814b-d612e2d718de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f60bf5-8df2-4ba4-b524-49c13a1fd1b3', 'volume_name': 'volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1850c1d-2ff2-47d0-b5a8-c22f412bb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1850c1d-2ff2-47d0-b5a8-c22f412bb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5211a207-c491-4350-a74f-40e1ab77664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume 42f60bf5-8df2-4ba4-b524-49c13a1fd1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3', 'volume_size': 1} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-84e9973e-ac1c-4343-adab-c4c3d44fdc4e-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-quobyte-84e9973e-ac1c-4343-adab-c4c3d44fdc4e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-84e9973e-ac1c-4343-adab-c4c3d44fdc4e" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c5a6b-e364-4ec2-909d-098f4f8cba2c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:06 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 1073741824" returned: 0 in 0.543s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:06 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 Jul 20 16:58:06 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:06 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e Jul 20 16:58:06 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (6cc33442-f2a3-468e-9a37-1a64347abdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbab6db-7800-420a-a11b-97fc179b8b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbab6db-7800-420a-a11b-97fc179b8b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96571683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:07Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0896b781-5a1b-4ba8-9237-cf344a35c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0896b781-5a1b-4ba8-9237-cf344a35c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f89416-8c8a-479d-9f2d-30de91fea452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f89416-8c8a-479d-9f2d-30de91fea452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6', 'volume_name': 'volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12812482-40bb-4297-a35b-1eeca78b493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12812482-40bb-4297-a35b-1eeca78b493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464befe6-1f8c-40b5-adaa-73233973ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6', 'volume_size': 1} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:06 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7" returned: 0 in 0.319s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.296s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048332445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093698f6-ae34-4ecb-906a-19e5003b9844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:01Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Creating volume 093698f6-ae34-4ecb-906a-19e5003b9844 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7ee9e5-ff38-4775-a19e-27148ed76a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ce71c5-d435-4e0a-9a6d-79b1bebb7d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:06 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 1073741824 Jul 20 16:58:06 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:06 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 (3cf28929-d393-45d9-8ee2-cc418c9ecdf7): created successfully Jul 20 16:58:06 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ce71c5-d435-4e0a-9a6d-79b1bebb7d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (cde32412-e1d3-4501-a85f-8c6e9b486d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:07 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e" returned: 0 in 0.516s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7d26600a-6d04-4816-8a1d-2fdff66e6e71 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created volume successfully. Jul 20 16:58:07 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e Jul 20 16:58:07 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (0b24c3df-e4f4-4363-98f8-1f275e112f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53c980c-79d7-4257-9ac7-a512ada67bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53c980c-79d7-4257-9ac7-a512ada67bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894751668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f728666-e07a-4fb1-aa3f-a230c58c4def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:07Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7816fcd1-af8b-4cfd-ac66-9cb23bf675c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7816fcd1-af8b-4cfd-ac66-9cb23bf675c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854f73bc-0f9f-4c77-998e-9e2ca28d942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854f73bc-0f9f-4c77-998e-9e2ca28d942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f728666-e07a-4fb1-aa3f-a230c58c4def', 'volume_name': 'volume-4f728666-e07a-4fb1-aa3f-a230c58c4def', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093d7776-f909-4804-96e3-3a334ac73059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093d7776-f909-4804-96e3-3a334ac73059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51a80e4-2b38-4477-ae81-7e8dbba49a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume 4f728666-e07a-4fb1-aa3f-a230c58c4def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f728666-e07a-4fb1-aa3f-a230c58c4def', 'volume_size': 1} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:07 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-84e9973e-ac1c-4343-adab-c4c3d44fdc4e" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-84e9973e-ac1c-4343-adab-c4c3d44fdc4e" released by "delete_volume" :: held 0.910s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Created reservations ['7a424743-6fa4-4b8d-8ba4-3789063badf8', 'b89b7939-4bd8-4ea0-8395-995bd7bb7972', '167c121d-7cb4-4a2a-9caa-d5125e1973cc', '350b4704-d9c2-4df0-8431-2f7992d124ab'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:07 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (c63ec86b-e14a-405a-bd9e-6a9e84d8301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020a825e-bef5-48fe-837f-8394f107fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 1073741824" returned: 0 in 0.630s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020a825e-bef5-48fe-837f-8394f107fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754131838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4575d015-a547-487a-8376-28f05b599093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:07Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fecdfe2-27d3-44e7-90fa-db69fa0c4d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fecdfe2-27d3-44e7-90fa-db69fa0c4d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08565902-f64b-434c-bf90-e6b1dd7c6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08565902-f64b-434c-bf90-e6b1dd7c6a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4575d015-a547-487a-8376-28f05b599093', 'volume_name': 'volume-4575d015-a547-487a-8376-28f05b599093', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d123596-b330-48fd-b244-180486d39c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d123596-b330-48fd-b244-180486d39c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc95333-d1bb-480e-a22c-568fe6213699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume 4575d015-a547-487a-8376-28f05b599093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4575d015-a547-487a-8376-28f05b599093', 'volume_size': 1} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:07 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:07 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:07 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 Jul 20 16:58:07 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:07 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.269s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Deleted volume successfully. Jul 20 16:58:07 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844" returned: 0 in 0.251s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d39a310-e512-4383-bee1-5dd58cd49d69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-84e9973e-ac1c-4343-adab-c4c3d44fdc4e-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.849s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034812898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6978a7-ee39-4a56-a37f-8f87bc383d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:02Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Creating volume 2e6978a7-ee39-4a56-a37f-8f87bc383d2c {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73762510-5148-4aac-8403-5a3a3c5c5a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093698f6-ae34-4ecb-906a-19e5003b9844', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65a0954-e13c-4254-8414-ff2b8cf331ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:07 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c 1073741824 Jul 20 16:58:07 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume volume-093698f6-ae34-4ecb-906a-19e5003b9844 (093698f6-ae34-4ecb-906a-19e5003b9844): created successfully Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65a0954-e13c-4254-8414-ff2b8cf331ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (960155be-8996-4fa7-8dfd-a84d6fff4a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2ad4fc38-2ff1-413c-8bf0-e168cfd35c50 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created volume successfully. Jul 20 16:58:08 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c 1073741824" returned: 0 in 0.430s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:08 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c Jul 20 16:58:08 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:08 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c" returned: 0 in 0.266s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-quobyte-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.233s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331166538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5040a5fa6e024fa6a17919935b59c974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:02Z,use_quota=True,user_id='2d0f2ee4a6af4076a4ea7b3741308cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Creating volume ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:08 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:08 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 1073741824 Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6f0f63-9578-4c57-a091-736d079fc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:08 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b9d6be-eb1b-4c07-96f2-3bbc6637147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68" acquired by "delete_volume" :: waited 0.065s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:08 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c (2e6978a7-ee39-4a56-a37f-8f87bc383d2c): created successfully Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b9d6be-eb1b-4c07-96f2-3bbc6637147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (aa11f5a3-bf3f-4ee3-b949-6da0115d6412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56678e-4a65-469c-add3-689c24289f39]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ffe0a9b1-37e7-473d-b641-8d8ac87a4118 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created volume successfully. Jul 20 16:58:08 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 Jul 20 16:58:08 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:09 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 1073741824" returned: 0 in 0.428s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:09 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:09 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 Jul 20 16:58:09 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:09 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68 Jul 20 16:58:09 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:09 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.190s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e8490e-4e65-4dfd-af52-2808b2457679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffd23d380784c04b30e7eec2b4ab4d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:01Z,use_quota=True,user_id='9a3df1b6845c4b21b839880357cf16ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2d71ec-fbe5-4d11-8c29-936428296ca8),volume_type_id=6c2d71ec-fbe5-4d11-8c29-936428296ca8)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Creating volume a3e8490e-4e65-4dfd-af52-2808b2457679 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:09 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:09 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:09 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 1073741824 Jul 20 16:58:09 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786b7e84-e6e4-4b6b-b2e3-32e7ce466efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c0ded2-3507-4801-97f3-2d669ab9a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68" released by "delete_volume" :: held 0.741s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Volume volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 (ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73): created successfully Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c0ded2-3507-4801-97f3-2d669ab9a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Flow 'volume_create_manager' (bd63a3f0-1404-4b37-9dfc-e062965c151b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1296d6ec-29ed-43e7-9e4f-55accce46f36 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created volume successfully. Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Created reservations ['5e0ba745-f67a-4390-a185-da34018fc22a', '6556afe1-fcf0-49ac-9d77-81a73af9d5a1', '2b2bc7b3-6af0-48d8-82ec-51c8df72b517', '6565b3d7-34a2-4a9a-967d-40b2bfdd7881'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:09 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:09 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-c826121f-9cef-4182-a97f-98eb6ba41367-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-c826121f-9cef-4182-a97f-98eb6ba41367-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-quobyte-c826121f-9cef-4182-a97f-98eb6ba41367" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-c826121f-9cef-4182-a97f-98eb6ba41367" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:09 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbc69f-115f-42e8-9283-0ca6a33893be]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Deleted volume successfully. Jul 20 16:58:09 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 1073741824" returned: 0 in 0.530s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-20a90065-ed68-4802-a1e2-28e97d0be833 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-e3b8eb49-7f09-4e6d-9fea-4fea686b4f68-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:10 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 Jul 20 16:58:10 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-quobyte-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d480d1-bb89-41e6-a66e-5ce7531f0915]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 Jul 20 16:58:10 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679" returned: 0 in 0.316s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:10 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.318s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047656900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4477ea6b-e6b2-4eb8-b123-482d6864ac49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:06Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating volume 4477ea6b-e6b2-4eb8-b123-482d6864ac49 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:10 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367" returned: 0 in 0.442s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 1073741824 Jul 20 16:58:10 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Attempting download of 26bafb98-eae2-4221-8d4c-7ad0e21073fd ((None, [{'url': 'file:///opt/stack/data/glance/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'metadata': {}}])) to volume a3e8490e-4e65-4dfd-af52-2808b2457679. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:58:10 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367 Jul 20 16:58:10 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e9847c-3449-4150-ac7d-1b31df475f4c]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif Jul 20 16:58:10 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73" returned: 0 in 0.451s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73 Jul 20 16:58:10 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-c826121f-9cef-4182-a97f-98eb6ba41367" returned: 0 in 0.314s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-c826121f-9cef-4182-a97f-98eb6ba41367" released by "delete_volume" :: held 0.810s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Created reservations ['b7409d8c-63df-4e88-9105-63f2bc2d6c41', '6899134f-1d3a-4dd7-9894-b9bcd33fc25d', 'ae53a321-3560-4369-bcb2-9aeeb7e30546', 'd54daa5d-f369-416f-8467-ac261e64027f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:10 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 1073741824" returned: 0 in 0.559s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:10 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif" returned: 0 in 0.504s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:10 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:11 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 Jul 20 16:58:11 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73" released by "delete_volume" :: held 0.928s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:11 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif Jul 20 16:58:11 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-quobyte-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created reservations ['7478155f-4301-45c5-bf49-6bb3607b8538', 'c137326b-db3d-4c65-aa66-a61f212fa5f1', 'a2a80d91-76ba-40c8-995b-2559c1383a65', 'e9141eb0-4885-4f96-a9e7-d35d2a9b126a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a1d15-796d-4d37-9eaf-814be84599dd]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:11 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.371s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Deleted volume successfully. Jul 20 16:58:11 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:11 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d19e36f0-4abd-4d14-a116-4da3c848ad69 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-c826121f-9cef-4182-a97f-98eb6ba41367-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:11 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 Jul 20 16:58:11 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49" returned: 0 in 0.446s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.039s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59433655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f60bf5-8df2-4ba4-b524-49c13a1fd1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:06Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating volume 42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:11 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:11 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif" returned: 1 in 0.512s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26bafb98-eae2-4221-8d4c-7ad0e21073fd_tt0awpif' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e2043-6d99-47b1-9880-90ec4ae678f0]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:11 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 1073741824 Jul 20 16:58:11 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea680f0-c11f-4727-8555-f769b541b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8391208-735f-4ae6-964a-f67b9272c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:11 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 (4477ea6b-e6b2-4eb8-b123-482d6864ac49): created successfully Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8391208-735f-4ae6-964a-f67b9272c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (60a62e14-836e-4a46-92e4-b83006716577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7652df7f-6ad1-42a1-bdbb-4937346db380 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created volume successfully. Jul 20 16:58:11 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.341s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Deleted volume successfully. Jul 20 16:58:11 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD Jul 20 16:58:11 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-be677976-7061-4ab9-b479-b6568469b931 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-ca2b1a86-2ff4-4259-9a63-1cfc8dce1c73-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:11 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8" returned: 0 in 0.568s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:11 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8 Jul 20 16:58:11 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:11 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:11 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 1073741824" returned: 0 in 0.535s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8" returned: 0 in 0.276s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD Jul 20 16:58:12 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 Jul 20 16:58:12 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8" released by "delete_volume" :: held 0.913s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Created reservations ['f87c2dbb-96fa-4e2e-8749-8cce2ab02867', 'ebf6fd9b-4540-48f8-b3d0-b0bfd23d666e', '8d35a6c0-4090-4181-8fd1-19931ccdc7e7', 'ff10c64b-1bb0-4876-b011-7d0a08bf35bd'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:12 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:12 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3" returned: 0 in 0.297s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.509s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96571683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:07Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating volume b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:12 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-2e6978a7-ee39-4a56-a37f-8f87bc383d2c-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD" returned: 1 in 0.449s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:12 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 1073741824 Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] 26bafb98-eae2-4221-8d4c-7ad0e21073fd was raw, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:58:12 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5211a207-c491-4350-a74f-40e1ab77664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b2f6fa-b6be-41ed-a87a-613a57910ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:12 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 Jul 20 16:58:12 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-2e6978a7-ee39-4a56-a37f-8f87bc383d2c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:12 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 (42f60bf5-8df2-4ba4-b524-49c13a1fd1b3): created successfully Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b2f6fa-b6be-41ed-a87a-613a57910ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (2e504d3f-6b5b-4568-86b9-e07817a24f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.307s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1a993335-0649-47af-b5ac-3ff0e33c1ea1 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created volume successfully. Jul 20 16:58:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Deleted volume successfully. Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-quobyte-2e6978a7-ee39-4a56-a37f-8f87bc383d2c" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9807cab6-13be-4dbe-9fc4-9c8efe7f9949 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-1c010fbb-325e-4d88-a5fe-ffa19f52f7b8-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-2e6978a7-ee39-4a56-a37f-8f87bc383d2c" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a90afa0-c11a-438f-917b-f2005cd2e5ad]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c Jul 20 16:58:12 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 1073741824" returned: 0 in 0.521s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679" returned: 0 in 0.534s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26bafb98-eae2-4221-8d4c-7ad0e21073fd_uawmq546devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:58:12 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Converted 0.00 MB image at 0.00 MB/s Jul 20 16:58:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:12 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 Jul 20 16:58:12 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:12 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 1G Jul 20 16:58:12 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c" returned: 0 in 0.417s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c Jul 20 16:58:13 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6" returned: 0 in 0.257s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.961s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894751668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f728666-e07a-4fb1-aa3f-a230c58c4def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:07Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating volume 4f728666-e07a-4fb1-aa3f-a230c58c4def {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:13 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464befe6-1f8c-40b5-adaa-73233973ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1956443-0d66-4d06-bee2-4f981368de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:13 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def 1073741824 Jul 20 16:58:13 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 (b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6): created successfully Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1956443-0d66-4d06-bee2-4f981368de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (6cc33442-f2a3-468e-9a37-1a64347abdd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7c7f370c-afba-4061-b15a-f84dd7179c4a tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created volume successfully. Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:13 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 1G" returned: 0 in 0.431s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Downloaded image 26bafb98-eae2-4221-8d4c-7ad0e21073fd ((None, [{'url': 'file:///opt/stack/data/glance/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'metadata': {}}])) to volume a3e8490e-4e65-4dfd-af52-2808b2457679 successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Temporary image 26bafb98-eae2-4221-8d4c-7ad0e21073fd for user 9a3df1b6845c4b21b839880357cf16ea is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Marking volume a3e8490e-4e65-4dfd-af52-2808b2457679 as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "cinder-quobyte-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Copying metadata from image 26bafb98-eae2-4221-8d4c-7ad0e21073fd to a3e8490e-4e65-4dfd-af52-2808b2457679. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Creating volume glance metadata for volume a3e8490e-4e65-4dfd-af52-2808b2457679 backed by image 26bafb98-eae2-4221-8d4c-7ad0e21073fd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5001f17a7ad9dc1126f2fab4922d8443', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb" acquired by "delete_volume" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:13 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-2e6978a7-ee39-4a56-a37f-8f87bc383d2c" returned: 0 in 0.356s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0846e-1bab-4a2e-8112-6a8ab0f4e9f0]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-2e6978a7-ee39-4a56-a37f-8f87bc383d2c" released by "delete_volume" :: held 0.835s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e8374d-9607-41e1-b308-8a42f162d080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e8490e-4e65-4dfd-af52-2808b2457679', 'volume_size': 1, 'image_id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5001f17a7ad9dc1126f2fab4922d8443', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ffd23d380784c04b30e7eec2b4ab4d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9eaa7039ffaee374d94d247b89e4a8c418aab53c73ca5e21b58520eec5e68f8f29bde5ae5ee0d5dc9838a82756600d09c9789de6ae64666d34d439ec427d5157', 'id': '26bafb98-eae2-4221-8d4c-7ad0e21073fd', 'created_at': datetime.datetime(2026, 7, 20, 14, 57, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26bafb98-eae2-4221-8d4c-7ad0e21073fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ef8e50-0677-4793-9967-6552b2ea4f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created reservations ['926dcec3-2af0-4bb6-92e2-190198a6c60b', '3c005188-5d70-4f8e-802a-40bdc3557cb2', '0e4ee4b4-fdc4-4390-b1fe-41088ff3f717', '5fc6f963-dfa9-4237-9d68-e5132d9c1e36'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Volume volume-a3e8490e-4e65-4dfd-af52-2808b2457679 (a3e8490e-4e65-4dfd-af52-2808b2457679): created successfully Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ef8e50-0677-4793-9967-6552b2ea4f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:13 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Flow 'volume_create_manager' (919cdac9-a4b2-415c-8faf-9b83c036121e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:13 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-325edff5-1a07-4634-98c1-11ef66c6ad9a tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Created volume successfully. Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:13 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Acquiring lock "cinder-a3e8490e-4e65-4dfd-af52-2808b2457679-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "cinder-a3e8490e-4e65-4dfd-af52-2808b2457679-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Acquiring lock "cinder-quobyte-a3e8490e-4e65-4dfd-af52-2808b2457679" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "cinder-quobyte-a3e8490e-4e65-4dfd-af52-2808b2457679" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:13 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def 1073741824" returned: 0 in 0.645s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637038d-b32f-4b5c-bc7d-4cbb7a1d4933]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb" returned: 0 in 0.493s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:13 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def Jul 20 16:58:13 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb Jul 20 16:58:13 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:13 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.311s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:13 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Deleted volume successfully. Jul 20 16:58:13 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 Jul 20 16:58:13 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-58d9522a-d9b9-4215-a130-a680442c4869 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-2e6978a7-ee39-4a56-a37f-8f87bc383d2c-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:14 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.557s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754131838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4575d015-a547-487a-8376-28f05b599093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='185808e081d0438a80c2497b0937dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:07Z,use_quota=True,user_id='392166b7a75d431a9a318cb13468cccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Creating volume 4575d015-a547-487a-8376-28f05b599093 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:14 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:14 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51a80e4-2b38-4477-ae81-7e8dbba49a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f728666-e07a-4fb1-aa3f-a230c58c4def', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:14 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 1073741824 Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28635a6b-82fb-4339-9b40-d4c91f8aad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:14 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb" returned: 0 in 0.308s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-quobyte-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb" released by "delete_volume" :: held 0.849s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:14 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume volume-4f728666-e07a-4fb1-aa3f-a230c58c4def (4f728666-e07a-4fb1-aa3f-a230c58c4def): created successfully Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28635a6b-82fb-4339-9b40-d4c91f8aad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (0b24c3df-e4f4-4363-98f8-1f275e112f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c78114ca-8835-4428-b5df-43cba79af38d tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created volume successfully. Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Created reservations ['6fc0fe57-63c6-4fb8-b229-a2f29b4dcd1a', '38ed1e10-a129-4bf1-bf6b-050296c40007', 'c48a3fe7-adf3-466e-bcf1-81e48983a7c9', '53833379-0d69-4ff8-9fc1-1edabb1c69ad'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:14 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679" returned: 0 in 0.493s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:14 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679 Jul 20 16:58:14 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:14 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:14 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:14 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-093698f6-ae34-4ecb-906a-19e5003b9844-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a3e8490e-4e65-4dfd-af52-2808b2457679" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-093698f6-ae34-4ecb-906a-19e5003b9844-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "cinder-quobyte-a3e8490e-4e65-4dfd-af52-2808b2457679" released by "delete_volume" :: held 0.896s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:14 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:14 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 1073741824" returned: 0 in 0.572s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.341s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Deleted volume successfully. Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-quobyte-093698f6-ae34-4ecb-906a-19e5003b9844" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-093698f6-ae34-4ecb-906a-19e5003b9844" acquired by "delete_volume" :: waited 0.054s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Created reservations ['af949bf9-b72e-462f-83e7-43c300b6b58a', '51db1074-67d7-4794-9a34-115976c25ed0', '2f7e77cb-babf-4230-83f9-222179b7e7fa', '87988ab0-631f-4852-9af9-d46511c2b278'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e03d26-a744-40c2-93df-5e2ba202253f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:14 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 Jul 20 16:58:14 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-14e46e9b-0633-4db0-bf03-df3425a3fce8 tempest-CreateVolumesFromImageTest-142834257 None] Lock "cinder-4e4f63f1-c74a-45c0-b40b-c171f4bd9ccb-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:15 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:15 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:15 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 Jul 20 16:58:15 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:15 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093" returned: 0 in 0.299s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc95333-d1bb-480e-a22c-568fe6213699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4575d015-a547-487a-8376-28f05b599093', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c82ccc4-ab18-4050-9e6c-843269a82c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Volume volume-4575d015-a547-487a-8376-28f05b599093 (4575d015-a547-487a-8376-28f05b599093): created successfully Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c82ccc4-ab18-4050-9e6c-843269a82c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Flow 'volume_create_manager' (c63ec86b-e14a-405a-bd9e-6a9e84d8301f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-80c3c4c6-1585-4ee0-ad8e-2731c61987d4 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created volume successfully. Jul 20 16:58:15 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844" returned: 0 in 0.439s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:15 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Deleted volume successfully. Jul 20 16:58:15 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844 Jul 20 16:58:15 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-7e367769-0426-4cbb-b4d9-7b1eacab9ecf tempest-VolumeAndVolumeTypeFromImageTest-1167213481 None] Lock "cinder-a3e8490e-4e65-4dfd-af52-2808b2457679-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:15 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-093698f6-ae34-4ecb-906a-19e5003b9844" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-093698f6-ae34-4ecb-906a-19e5003b9844" released by "delete_volume" :: held 0.778s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created reservations ['85b4ebe9-95db-430f-8691-4e399ed0bd1d', '2a0ed730-5502-4e7b-80bf-7d58ddf7b7b0', '884fceb3-4847-4c4a-a7a0-8b956a6726f1', 'd13bbaae-e1ef-4777-9a26-d798a918bced'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:15 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:15 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-3cf28929-d393-45d9-8ee2-cc418c9ecdf7-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-3cf28929-d393-45d9-8ee2-cc418c9ecdf7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-quobyte-3cf28929-d393-45d9-8ee2-cc418c9ecdf7" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-3cf28929-d393-45d9-8ee2-cc418c9ecdf7" acquired by "delete_volume" :: waited 0.035s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6468b66f-bb62-4708-9b36-7c472e8725fa]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:16 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.419s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Deleted volume successfully. Jul 20 16:58:16 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 Jul 20 16:58:16 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3337cfea-b84e-4230-9590-5f9a56599bf7 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-093698f6-ae34-4ecb-906a-19e5003b9844-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-4575d015-a547-487a-8376-28f05b599093-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-4575d015-a547-487a-8376-28f05b599093-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-4575d015-a547-487a-8376-28f05b599093" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-4575d015-a547-487a-8376-28f05b599093" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf68ec-c15b-42f7-8e65-2be5d3db7a4b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:16 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7" returned: 0 in 0.532s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:16 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7 Jul 20 16:58:16 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:16 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 Jul 20 16:58:16 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:17 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-3cf28929-d393-45d9-8ee2-cc418c9ecdf7" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-3cf28929-d393-45d9-8ee2-cc418c9ecdf7" released by "delete_volume" :: held 1.003s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:17 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093" returned: 0 in 0.485s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:17 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093 Jul 20 16:58:17 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created reservations ['ef8d8291-0829-40b6-acde-2de2c5a5178a', '849c2366-2679-4096-ab17-a8032f835434', '025867ed-659b-4138-ae92-9b9e96cdc476', '0503b3a9-e50c-4a40-92b2-603cc0855565'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:17 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:17 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:17 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4575d015-a547-487a-8376-28f05b599093" returned: 0 in 0.321s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-4575d015-a547-487a-8376-28f05b599093" released by "delete_volume" :: held 0.854s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['60a96d64-5240-469e-a9ad-890f959272a0', '5ba3fa2d-06e3-4dc9-8d9c-e44a0fbf0e18', '1b39262f-e317-49b0-9d2a-7284e069a7d8', '6e6074f1-e781-488c-b60f-a0f21b050730'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:17 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.273s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Deleted volume successfully. Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d1d819b-1f19-4c5a-a212-347c8b204c84 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-3cf28929-d393-45d9-8ee2-cc418c9ecdf7-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:17 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:17 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-4f728666-e07a-4fb1-aa3f-a230c58c4def-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-4f728666-e07a-4fb1-aa3f-a230c58c4def-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-4f728666-e07a-4fb1-aa3f-a230c58c4def" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-4f728666-e07a-4fb1-aa3f-a230c58c4def" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021bb02-1745-4f86-b7b9-a4217f9f93d1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:17 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.382s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:17 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleted volume successfully. Jul 20 16:58:18 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def Jul 20 16:58:18 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0239676-6786-43b8-89e8-f5459027cc56 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-4575d015-a547-487a-8376-28f05b599093-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-07b6e403-1987-4b08-9691-2f08ff6b8dbc-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-07b6e403-1987-4b08-9691-2f08ff6b8dbc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-quobyte-07b6e403-1987-4b08-9691-2f08ff6b8dbc" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:18 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def" returned: 0 in 0.470s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-07b6e403-1987-4b08-9691-2f08ff6b8dbc" acquired by "delete_volume" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:18 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def Jul 20 16:58:18 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[47db9255-1d35-4b20-b5b8-e9f6489c6d43]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:18 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc Jul 20 16:58:18 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:18 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4f728666-e07a-4fb1-aa3f-a230c58c4def" returned: 0 in 0.321s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-4f728666-e07a-4fb1-aa3f-a230c58c4def" released by "delete_volume" :: held 0.864s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['937d9783-28e2-4175-94e7-325a98b74fd2', 'a8d10514-6316-4f15-93c8-a2fcc6f5965c', '30059aee-857b-45d9-a235-e4014a8539f4', 'f6baa1df-f5ce-4be8-a77f-6d08c75afcf5'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:18 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:18 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:18 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc" returned: 0 in 0.518s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:18 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc Jul 20 16:58:18 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b967e5-1d3a-413e-8d68-0d3cf1a6609e]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:19 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.432s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:19 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-07b6e403-1987-4b08-9691-2f08ff6b8dbc" returned: 0 in 0.376s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleted volume successfully. Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-07b6e403-1987-4b08-9691-2f08ff6b8dbc" released by "delete_volume" :: held 0.970s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-510b709e-a7f2-41bd-8885-e9d547986667 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-4f728666-e07a-4fb1-aa3f-a230c58c4def-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:19 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 Jul 20 16:58:19 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created reservations ['56e7f244-8882-478c-a8d7-52687343016b', 'b51b1cd3-e20f-4a0e-abbe-b596fa7f47ef', '418f1779-faa8-4d33-84f0-926b0648d63a', 'c42ba87f-d559-4cd4-ae58-ccaecdb18ba4'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:19 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:19 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:19 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6" returned: 0 in 0.627s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:19 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6 Jul 20 16:58:19 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:19 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.442s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Deleted volume successfully. Jul 20 16:58:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9c53741c-3066-4d5d-b2bc-ff96aee7f33d tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-07b6e403-1987-4b08-9691-2f08ff6b8dbc-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:20 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (8a68e5cd-e2c0-4759-ab63-3073a0c18745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828f50b8-5700-4758-af64-713546c75ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6" released by "delete_volume" :: held 1.062s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828f50b8-5700-4758-af64-713546c75ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694725842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1940a337-321b-4ec6-8959-3f581d5198c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:20Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d300418c-270f-4f72-9b3a-56df688d20a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d300418c-270f-4f72-9b3a-56df688d20a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c61a47-6639-4398-82f5-b54951f6b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c61a47-6639-4398-82f5-b54951f6b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1940a337-321b-4ec6-8959-3f581d5198c0', 'volume_name': 'volume-1940a337-321b-4ec6-8959-3f581d5198c0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f344ac8d-cec7-46f5-a492-d1ef32c9a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f344ac8d-cec7-46f5-a492-d1ef32c9a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c85dda-f69e-4375-a483-38cc87cfffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:20 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Volume 1940a337-321b-4ec6-8959-3f581d5198c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1940a337-321b-4ec6-8959-3f581d5198c0', 'volume_size': 1} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694725842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1940a337-321b-4ec6-8959-3f581d5198c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:20Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Creating volume 1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:20 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:20 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 1073741824 Jul 20 16:58:20 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['1afe8f8d-4c7c-49e9-aa81-c72bebe26b4e', '93ca0650-9445-45d3-92db-bf965b89b17d', '41e27567-9a95-40c2-a30d-7efc30e2ba8c', 'c93a5cba-b0c7-4d6a-a94b-66779f814ded'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:20 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:20 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-fe198fa0-a450-4016-a773-f00680671aa5-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-fe198fa0-a450-4016-a773-f00680671aa5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "cinder-quobyte-fe198fa0-a450-4016-a773-f00680671aa5" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-fe198fa0-a450-4016-a773-f00680671aa5" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22ca1d7-582b-4de4-9470-12a6c5220cc9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:20 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.310s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleted volume successfully. Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-fe97b359-a656-4ce5-9408-b76909f3e1f6 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-b1e3cacd-e3d4-4bfb-81c9-a0058ed03da6-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:20 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 Jul 20 16:58:20 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:20 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 1073741824" returned: 0 in 0.586s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:20 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 Jul 20 16:58:20 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:21 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5" returned: 0 in 0.451s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:21 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0" returned: 0 in 0.274s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:21 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5 Jul 20 16:58:21 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c85dda-f69e-4375-a483-38cc87cfffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1940a337-321b-4ec6-8959-3f581d5198c0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e72489e-1adf-4a11-8304-fe882bab8f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Volume volume-1940a337-321b-4ec6-8959-3f581d5198c0 (1940a337-321b-4ec6-8959-3f581d5198c0): created successfully Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e72489e-1adf-4a11-8304-fe882bab8f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (8a68e5cd-e2c0-4759-ab63-3073a0c18745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9e03068f-e355-48b1-9a28-dcd347be4fe7 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ef8e3-9b37-433e-a54e-5f82bb4a3feb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:21 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-fe198fa0-a450-4016-a773-f00680671aa5" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-quobyte-fe198fa0-a450-4016-a773-f00680671aa5" released by "delete_volume" :: held 0.794s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Created reservations ['e7e94c0f-6e92-4b2f-9f8c-140e30ab889f', '04761534-4ab2-4d92-b5ad-e0fc4bf40376', '95c87e02-2b68-4fe1-b37e-3352e928fef6', '29101f69-e14e-4787-acd0-312961b3e752'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:21 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 Jul 20 16:58:21 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:21 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:21 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:21 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:21 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3 Jul 20 16:58:21 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:21 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.347s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Deleted volume successfully. Jul 20 16:58:21 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-97e18c71-970d-41d1-924b-37bb1d786345 tempest-CreateVolumesFromSourceVolumeTest-695518581 None] Lock "cinder-fe198fa0-a450-4016-a773-f00680671aa5-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:22 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Flow 'volume_create_manager' (e3ea27a9-af70-4c2e-b126-e4e5b1354b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba89d20-fa07-4521-8391-d333f5c4bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3" returned: 0 in 0.383s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba89d20-fa07-4521-8391-d333f5c4bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1376676773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc3892-f733-4e97-a54d-cc76ba400a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3da79e3fdf42f48f27f33e65354676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:22Z,use_quota=True,user_id='eec2a7d299174ef3a37e73e4a8d7807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f037f9b4-7327-4d76-868e-77df1524fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f037f9b4-7327-4d76-868e-77df1524fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20089b7c-1d20-4111-b13c-81c0c3504804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20089b7c-1d20-4111-b13c-81c0c3504804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cc3892-f733-4e97-a54d-cc76ba400a9b', 'volume_name': 'volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076288e0-adca-477d-a9f8-b49ea6f6d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076288e0-adca-477d-a9f8-b49ea6f6d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca79ad8-a4f3-4364-99e3-0fac793952de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Volume a2cc3892-f733-4e97-a54d-cc76ba400a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b', 'volume_size': 1} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1376676773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc3892-f733-4e97-a54d-cc76ba400a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3da79e3fdf42f48f27f33e65354676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:22Z,use_quota=True,user_id='eec2a7d299174ef3a37e73e4a8d7807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Creating volume a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:22 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3" released by "delete_volume" :: held 0.901s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:22 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b 1073741824 Jul 20 16:58:22 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['643dfef8-7440-4c1c-9cce-5654e51bd843', '590b8f54-3745-49dc-b177-1ca9d55b168b', '19f1e2b0-2896-427d-bcef-7341e0f1f337', 'fe7a13b8-8873-4557-b89c-b1b9007e2bf1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:22 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:22 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-4477ea6b-e6b2-4eb8-b123-482d6864ac49-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-4477ea6b-e6b2-4eb8-b123-482d6864ac49-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-4477ea6b-e6b2-4eb8-b123-482d6864ac49" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-4477ea6b-e6b2-4eb8-b123-482d6864ac49" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c26528-c4dc-4c8e-a63a-00cbdeaa794b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:22 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.447s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleted volume successfully. Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1a5366b3-54b7-4ec5-90b5-32341dca4ab3 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-42f60bf5-8df2-4ba4-b524-49c13a1fd1b3-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:22 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 Jul 20 16:58:22 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:22 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b 1073741824" returned: 0 in 0.772s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:23 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:23 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:23 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49" returned: 0 in 0.455s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:23 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49 Jul 20 16:58:23 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:23 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.296s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.496s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot 84cc6083-fad0-4947-9c85-51ac1141a695 of volume 1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca79ad8-a4f3-4364-99e3-0fac793952de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa219330-e841-4001-9844-ea12f1e85d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7992b2a-ae1c-4904-803f-1dc6175854da]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:23 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Volume volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b (a2cc3892-f733-4e97-a54d-cc76ba400a9b): created successfully Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa219330-e841-4001-9844-ea12f1e85d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Flow 'volume_create_manager' (e3ea27a9-af70-4c2e-b126-e4e5b1354b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:23 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9a194409-b294-41d5-a460-47a533f33055 tempest-VolumeDependencyTests-898535217 None] Created volume successfully. Jul 20 16:58:23 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-4477ea6b-e6b2-4eb8-b123-482d6864ac49" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:23 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 Jul 20 16:58:23 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-4477ea6b-e6b2-4eb8-b123-482d6864ac49" released by "delete_volume" :: held 0.809s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['b43756a1-3f26-43fd-a463-8a2c695b01b4', '224c5644-d1da-4b57-9a0d-4ce990ffddd2', 'ff12ed7e-a4a6-4b30-8711-1391bf6b01d5', 'acb3829f-ad5d-4b36-ab08-a8ca55e38ccf'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:23 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:23 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:23 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0" returned: 0 in 0.444s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-f920d246-42fc-40ee-8c6b-54eb2099019c-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-f920d246-42fc-40ee-8c6b-54eb2099019c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-61f7384f-1694-45c4-b85f-0c1935676edc" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:23 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 1G Jul 20 16:58:23 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-61f7384f-1694-45c4-b85f-0c1935676edc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-f920d246-42fc-40ee-8c6b-54eb2099019c" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-f920d246-42fc-40ee-8c6b-54eb2099019c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleting offline snapshot f920d246-42fc-40ee-8c6b-54eb2099019c of volume 61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] snapshot_file for this snap is: volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6d5a70-13c1-4a49-a9fe-f6f989a22cb0]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:23 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.384s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleted volume successfully. Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dd7cde9-c0e1-491c-a05b-88fe2ff86d61 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-4477ea6b-e6b2-4eb8-b123-482d6864ac49-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:24 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c Jul 20 16:58:24 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:24 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 1G" returned: 0 in 0.564s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1940a337-321b-4ec6-8959-3f581d5198c0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:24 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1940a337-321b-4ec6-8959-3f581d5198c0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 Jul 20 16:58:24 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:24 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c" returned: 0 in 0.488s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f7384f-1694-45c4-b85f-0c1935676edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3af124-162a-474f-9b51-5bc61b0f3571]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:24 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc Jul 20 16:58:24 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:24 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1940a337-321b-4ec6-8959-3f581d5198c0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695" returned: 0 in 0.368s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:24 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 is being set with open permissions: ugo+rw Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:24 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 Jul 20 16:58:24 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:24 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc" returned: 0 in 0.425s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:24 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c Jul 20 16:58:24 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:25 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:25 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info Jul 20 16:58:25 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:25 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c" returned: 0 in 0.363s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:25 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c Jul 20 16:58:25 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:25 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:25 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info is being set with open permissions: ugo+rw Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:25 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info Jul 20 16:58:25 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:25 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc.f920d246-42fc-40ee-8c6b-54eb2099019c" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-f920d246-42fc-40ee-8c6b-54eb2099019c" released by "_delete_snapshot" :: held 1.662s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-61f7384f-1694-45c4-b85f-0c1935676edc" released by "delete_snapshot" :: held 1.695s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:25 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.info" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.209s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Creating offline snapshot 21ce7090-0bd3-4566-8ab5-f52e48b4ac21 of volume a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['33a3e0ed-771e-4748-8ea1-1862ea0bae82', '1b3725b5-e165-4663-ab1a-62ea8d378a3a', 'ed054b5f-4fd3-45b7-b524-d3677242dc3c', '09d5ab19-f0d6-4c41-a0d3-bdbecd43cedb'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64ca23-e5d7-4c77-9cb2-81cd82e0c5b4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0b87ffec-0fe7-48b4-89ee-436718f729b7 tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:58:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Delete snapshot completed successfully. Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-75056548-0b4e-450a-b758-f7b0cbb67a81 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-f920d246-42fc-40ee-8c6b-54eb2099019c-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:25 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:25 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-84cc6083-fad0-4947-9c85-51ac1141a695-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Lock "cinder-84cc6083-fad0-4947-9c85-51ac1141a695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-1940a337-321b-4ec6-8959-3f581d5198c0" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1940a337-321b-4ec6-8959-3f581d5198c0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-84cc6083-fad0-4947-9c85-51ac1141a695" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-84cc6083-fad0-4947-9c85-51ac1141a695" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot 84cc6083-fad0-4947-9c85-51ac1141a695 of volume 1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-61f7384f-1694-45c4-b85f-0c1935676edc-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[727549d0-4d3b-4781-96b9-9b88b89a1e97]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-61f7384f-1694-45c4-b85f-0c1935676edc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "cinder-quobyte-61f7384f-1694-45c4-b85f-0c1935676edc" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-61f7384f-1694-45c4-b85f-0c1935676edc" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce3715-8f02-4524-a9a3-93d4aed8ab3b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:26 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:26 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 Jul 20 16:58:26 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.501s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:26 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 1G Jul 20 16:58:26 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:26 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc Jul 20 16:58:26 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:26 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695" returned: 0 in 0.472s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1940a337-321b-4ec6-8959-3f581d5198c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae75921-c1e4-4e21-a850-0cec62ba2c96]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:26 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc" returned: 0 in 0.432s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:26 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc Jul 20 16:58:26 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:26 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 1G" returned: 0 in 0.486s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:26 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 Jul 20 16:58:26 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:26 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 Jul 20 16:58:26 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:26 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-61f7384f-1694-45c4-b85f-0c1935676edc" returned: 0 in 0.316s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-quobyte-61f7384f-1694-45c4-b85f-0c1935676edc" released by "delete_volume" :: held 0.826s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:26 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0" returned: 0 in 0.440s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:27 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 Jul 20 16:58:27 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Created reservations ['0cca9410-f5f4-42c6-986b-721ee6848d47', '3fe1e261-0da0-489a-95df-a56135ed144e', 'b7cac535-6d65-459b-a63b-5e7a227cadd5', '1d715461-3274-431e-91c7-3e0f401b4a58'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:27 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21" returned: 0 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:27 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 is being set with open permissions: ugo+rw Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:27 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 Jul 20 16:58:27 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:27 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:27 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:27 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:27 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695" returned: 0 in 0.489s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Deleted volume successfully. Jul 20 16:58:27 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:27 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695 Jul 20 16:58:27 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21" returned: 0 in 0.477s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3368f87f-8c88-41b8-bf78-9cd53a5e2e46 tempest-CreateVolumesFromSnapshotTest-1072319611 None] Lock "cinder-61f7384f-1694-45c4-b85f-0c1935676edc-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:27 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info Jul 20 16:58:27 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:27 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0.84cc6083-fad0-4947-9c85-51ac1141a695" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-84cc6083-fad0-4947-9c85-51ac1141a695" released by "_delete_snapshot" :: held 1.888s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1940a337-321b-4ec6-8959-3f581d5198c0" released by "delete_snapshot" :: held 1.915s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:27 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:27 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info is being set with open permissions: ugo+rw Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:27 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Created reservations ['8bfbc533-3e30-479c-aba5-6b10b1194a3a', '8c3c0d76-5985-41e8-ab47-c5eeb8278d34', '092b8124-5793-467b-a116-ea6c943dcfed', '9ea4f402-58c1-4733-96cd-804e7f9068da'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:27 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info Jul 20 16:58:27 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-16e89987-c38e-4dc6-9671-c5bee021eb1e tempest-ProjectMemberTests-1121326326 None] Lock "cinder-84cc6083-fad0-4947-9c85-51ac1141a695-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-1940a337-321b-4ec6-8959-3f581d5198c0-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-1940a337-321b-4ec6-8959-3f581d5198c0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Flow 'volume_create_manager' (a44f7f31-fc4d-4ab5-9004-d454f0ea430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44eaaf1-d7f2-4cd4-8ff7-6dea538d0fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-1940a337-321b-4ec6-8959-3f581d5198c0" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44eaaf1-d7f2-4cd4-8ff7-6dea538d0fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a6d32b-f0a4-46ff-8e4f-f22f976e3553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10ce3befe524ca093c12227c11bdc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:28Z,use_quota=True,user_id='646c8f257c1347dea785859950acfacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdaa44a-1f77-4c9f-9400-7d3385e04cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:28 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdaa44a-1f77-4c9f-9400-7d3385e04cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab5e23a-0e15-4048-9ad7-1a5981c2fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.image.glance [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Creating Keystone auth plugin from conf {{(pid=87535) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.info" returned: 0 in 0.398s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1940a337-321b-4ec6-8959-3f581d5198c0" acquired by "delete_volume" :: waited 0.074s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df8e556-f1a1-41c4-8975-fb9781390dae]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-41ba6c79-e949-48ee-bcda-d60125962990 tempest-VolumeDependencyTests-898535217 None] Create snapshot completed successfully Jul 20 16:58:28 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 Jul 20 16:58:28 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab5e23a-0e15-4048-9ad7-1a5981c2fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7a6d32b-f0a4-46ff-8e4f-f22f976e3553', 'volume_name': 'volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553', 'volume_size': 1, 'image_id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29eac145-a2db-47da-8004-2fab9bc7b556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d86c45dee7308f3b3a03465fe2897ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b10ce3befe524ca093c12227c11bdc89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c1840238f91f11c242e070edaae4fd1c254d40494832364d09ea634ad6a97dd74b42070808edd540f0e811191309d312331c38440adcd698478f5df534e10d9e', 'id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'created_at': datetime.datetime(2026, 7, 20, 14, 58, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 58, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29eac145-a2db-47da-8004-2fab9bc7b556/file', 'properties': {}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dba93b-a615-4cd2-8c37-3546ac943f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dba93b-a615-4cd2-8c37-3546ac943f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6674401a-4953-4994-ae53-e2db674f89f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:28 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Volume f7a6d32b-f0a4-46ff-8e4f-f22f976e3553: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553', 'volume_size': 1, 'image_id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29eac145-a2db-47da-8004-2fab9bc7b556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d86c45dee7308f3b3a03465fe2897ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b10ce3befe524ca093c12227c11bdc89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c1840238f91f11c242e070edaae4fd1c254d40494832364d09ea634ad6a97dd74b42070808edd540f0e811191309d312331c38440adcd698478f5df534e10d9e', 'id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'created_at': datetime.datetime(2026, 7, 20, 14, 58, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 58, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29eac145-a2db-47da-8004-2fab9bc7b556/file', 'properties': {}}, 'image_service': } Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Trying to clone f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 from image 29eac145-a2db-47da-8004-2fab9bc7b556 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29eac145-a2db-47da-8004-2fab9bc7b556', 'metadata': {}}]). {{(pid=87535) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 20 16:58:28 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Image download 0.00 MB at 0.00 MB/s Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e356ff73-4362-4479-9b9d-beb35d08b8f7]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:28 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0" returned: 0 in 0.553s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:29 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0 Jul 20 16:58:29 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:29 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD Jul 20 16:58:29 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:29 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1940a337-321b-4ec6-8959-3f581d5198c0" returned: 0 in 0.332s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1940a337-321b-4ec6-8959-3f581d5198c0" released by "delete_volume" :: held 0.957s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:29 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Created reservations ['bb25daf7-58a9-4a71-8c88-6144e125e612', 'a9466988-4dd6-40d6-a2f1-f577c441d45b', '5ce1d5a1-4adf-4d10-9c43-ac4783552f47', '27dd32ae-7c78-43c8-9bde-067047b7a2e6'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Flow 'volume_create_manager' (103eac9b-1c73-4e0f-af4d-14a83c47294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015e73bb-0b35-4380-9077-ccc400fb1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015e73bb-0b35-4380-9077-ccc400fb1daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-436026271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34ecf08-fe08-435c-a3d9-ffebc0fbd868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3da79e3fdf42f48f27f33e65354676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21ce7090-0bd3-4566-8ab5-f52e48b4ac21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:29Z,use_quota=True,user_id='eec2a7d299174ef3a37e73e4a8d7807c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd75a21-5e3c-4c66-aa52-7cc2853bb073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd75a21-5e3c-4c66-aa52-7cc2853bb073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e01df7-daec-44e0-8270-ea2ad7a7d16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e01df7-daec-44e0-8270-ea2ad7a7d16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f34ecf08-fe08-435c-a3d9-ffebc0fbd868', 'volume_name': 'volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868', 'volume_size': 1, 'snapshot_id': '21ce7090-0bd3-4566-8ab5-f52e48b4ac21'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6266d9f9-00ea-409c-b2aa-739dd2b798a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6266d9f9-00ea-409c-b2aa-739dd2b798a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16368187-21c3-43a6-a631-3845a58d174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:29 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Volume f34ecf08-fe08-435c-a3d9-ffebc0fbd868: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868', 'volume_size': 1, 'snapshot_id': '21ce7090-0bd3-4566-8ab5-f52e48b4ac21'} Jul 20 16:58:29 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD Jul 20 16:58:29 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-quobyte-21ce7090-0bd3-4566-8ab5-f52e48b4ac21-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-21ce7090-0bd3-4566-8ab5-f52e48b4ac21-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Creating volume f34ecf08-fe08-435c-a3d9-ffebc0fbd868 from snapshot 21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-quobyte-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] snapshot: 21ce7090-0bd3-4566-8ab5-f52e48b4ac21, volume: f34ecf08-fe08-435c-a3d9-ffebc0fbd868, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:29 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:29 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ab83fb-914d-4f46-9822-044afa6b76b7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:29 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Temporary image 29eac145-a2db-47da-8004-2fab9bc7b556 is fetched for user 646c8f257c1347dea785859950acfacb. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 20 16:58:29 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 Jul 20 16:58:29 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a71aa-b29e-492f-8502-a7bde9557dcc]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:30 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.355s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:30 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5772076-b367-44dd-962b-715154562d20 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-1940a337-321b-4ec6-8959-3f581d5198c0-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:30 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD Jul 20 16:58:30 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:30 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21" returned: 0 in 0.424s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0dba6b-9023-4556-a63e-f07dc18a5ac5]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:30 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:30 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:30 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:30 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD Jul 20 16:58:30 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:30 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.436s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:30 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 Jul 20 16:58:30 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:30 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD" returned: 1 in 0.478s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Flow 'volume_create_manager' (fda915ad-7125-40e7-8526-ecdf51c2c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f027e35c-991a-42af-8d4b-141ee3065731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f027e35c-991a-42af-8d4b-141ee3065731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9742ab0-528a-4359-95db-01c00e83c523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e3fa8f2514199a7d4c8dcdc2c9814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:31Z,use_quota=True,user_id='b11f6aa6f2ff4249b296498eabf2f554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500eba09-cf42-4ee5-a297-6738056a2632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500eba09-cf42-4ee5-a297-6738056a2632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c1580f-7ba4-465a-9071-5dc4990cea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c1580f-7ba4-465a-9071-5dc4990cea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9742ab0-528a-4359-95db-01c00e83c523', 'volume_name': 'volume-d9742ab0-528a-4359-95db-01c00e83c523', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0281a2-c153-45d6-94e8-db2c43f7c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0281a2-c153-45d6-94e8-db2c43f7c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa473430-3534-4db9-ae22-c6495f949540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Volume d9742ab0-528a-4359-95db-01c00e83c523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9742ab0-528a-4359-95db-01c00e83c523', 'volume_size': 1} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (94802be9-ef0e-49cb-bb41-77acfd84531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a174f1-4b57-49f4-babe-bc5dc85d3ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a174f1-4b57-49f4-babe-bc5dc85d3ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018042443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2b48bb-f6a0-44b9-8047-5afe94519c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:31Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34d1dbc-8aca-4bf0-bf0f-df377e277527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34d1dbc-8aca-4bf0-bf0f-df377e277527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635860a1-a31d-48b2-94de-07f466ee0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635860a1-a31d-48b2-94de-07f466ee0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2b48bb-f6a0-44b9-8047-5afe94519c07', 'volume_name': 'volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e93ba9-86a8-43cf-99fc-d8d79d6db28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e93ba9-86a8-43cf-99fc-d8d79d6db28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8343bfd9-ecd1-4575-a90e-55642dd57915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:31 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Volume cf2b48bb-f6a0-44b9-8047-5afe94519c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07', 'volume_size': 1} Jul 20 16:58:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:35 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" returned: 0 in 4.417s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ee19e-ab5c-4094-9546-f15f2763710f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:35 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:35 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:35 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.538s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:58:35 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Converted 1024.00 MB image at 231.76 MB/s Jul 20 16:58:35 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 is being set with open permissions: ugo+rw Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:35 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 Jul 20 16:58:35 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:35 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" released by "_copy_volume_from_snapshot" :: held 6.221s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-21ce7090-0bd3-4566-8ab5-f52e48b4ac21-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" released by "_create_volume_from_snapshot" :: held 6.255s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.280s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.060s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a6d32b-f0a4-46ff-8e4f-f22f976e3553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10ce3befe524ca093c12227c11bdc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:28Z,use_quota=True,user_id='646c8f257c1347dea785859950acfacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Creating volume f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:35 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:35 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 1073741824 Jul 20 16:58:35 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16368187-21c3-43a6-a631-3845a58d174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868', 'volume_size': 1, 'snapshot_id': '21ce7090-0bd3-4566-8ab5-f52e48b4ac21'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0e65c1-9a42-4f32-b13a-9b410e0abfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:35 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Volume volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 (f34ecf08-fe08-435c-a3d9-ffebc0fbd868): created successfully Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0e65c1-9a42-4f32-b13a-9b410e0abfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:35 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Flow 'volume_create_manager' (103eac9b-1c73-4e0f-af4d-14a83c47294a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c93a4fb7-48b3-4dfe-bfe9-ecee1f9d90c7 tempest-VolumeDependencyTests-898535217 None] Created volume successfully. Jul 20 16:58:36 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 1073741824" returned: 0 in 0.431s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:36 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 Jul 20 16:58:36 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:36 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.164s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9742ab0-528a-4359-95db-01c00e83c523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e3fa8f2514199a7d4c8dcdc2c9814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:31Z,use_quota=True,user_id='b11f6aa6f2ff4249b296498eabf2f554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Creating volume d9742ab0-528a-4359-95db-01c00e83c523 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:36 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:36 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 1073741824 Jul 20 16:58:36 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Attempting download of 29eac145-a2db-47da-8004-2fab9bc7b556 ((None, [{'url': 'file:///opt/stack/data/glance/images/29eac145-a2db-47da-8004-2fab9bc7b556', 'metadata': {}}])) to volume f7a6d32b-f0a4-46ff-8e4f-f22f976e3553. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ea0b0f-2cd9-4442-a197-6c68b20606f8]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:36 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5 Jul 20 16:58:36 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5" returned: 0 in 0.353s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 1073741824" returned: 0 in 0.469s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-21ce7090-0bd3-4566-8ab5-f52e48b4ac21-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Lock "cinder-21ce7090-0bd3-4566-8ab5-f52e48b4ac21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-quobyte-a2cc3892-f733-4e97-a54d-cc76ba400a9b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:37 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 Jul 20 16:58:37 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-a2cc3892-f733-4e97-a54d-cc76ba400a9b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-quobyte-21ce7090-0bd3-4566-8ab5-f52e48b4ac21" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-21ce7090-0bd3-4566-8ab5-f52e48b4ac21" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:37 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5 Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Deleting offline snapshot 21ce7090-0bd3-4566-8ab5-f52e48b4ac21 of volume a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:37 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] snapshot_file for this snap is: volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c011f723-3832-4198-b5bc-43f4407aa686]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 Jul 20 16:58:37 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.800s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018042443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2b48bb-f6a0-44b9-8047-5afe94519c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:31Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Creating volume cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:37 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:37 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5" returned: 1 in 0.421s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29eac145-a2db-47da-8004-2fab9bc7b556__caedtq5' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa473430-3534-4db9-ae22-c6495f949540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9742ab0-528a-4359-95db-01c00e83c523', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b245b719-845b-40fb-b1c6-327db2173db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:37 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 1073741824 Jul 20 16:58:37 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b96e25-1622-46d7-bf9b-fd5c14511353]: (4, 'raw') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Volume volume-d9742ab0-528a-4359-95db-01c00e83c523 (d9742ab0-528a-4359-95db-01c00e83c523): created successfully Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b245b719-845b-40fb-b1c6-327db2173db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Flow 'volume_create_manager' (fda915ad-7125-40e7-8526-ecdf51c2c38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:37 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-65a5476f-f6d0-4906-9906-73bad9ba0480 tempest-CinderUnicodeTest-743745662 None] Created volume successfully. Jul 20 16:58:37 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD Jul 20 16:58:37 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7945efeb-6a49-45ea-bf5e-338d486a56a7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:37 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:37 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:37 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 1073741824" returned: 0 in 0.496s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:38 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD Jul 20 16:58:38 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:38 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 Jul 20 16:58:38 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:38 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.431s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:38 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 Jul 20 16:58:38 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:38 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 20 16:58:38 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] 29eac145-a2db-47da-8004-2fab9bc7b556 was raw, converting to qcow2 {{(pid=87535) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:38 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 Jul 20 16:58:38 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8343bfd9-ecd1-4575-a90e-55642dd57915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf4ad73-ce50-471b-80f1-5ed751e695bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:38 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Volume volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 (cf2b48bb-f6a0-44b9-8047-5afe94519c07): created successfully Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf4ad73-ce50-471b-80f1-5ed751e695bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (94802be9-ef0e-49cb-bb41-77acfd84531c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:38 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-41487fc8-382d-4dac-adc5-1581c6da7067 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:58:38 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:38 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21 Jul 20 16:58:38 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:38 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b.21ce7090-0bd3-4566-8ab5-f52e48b4ac21" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:38 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot e200ca17-89c9-43ac-bf2f-13ff2e657094 of volume cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" returned: 0 in 0.623s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29eac145-a2db-47da-8004-2fab9bc7b556__q3hdp3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 16:58:38 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Converted 0.00 MB image at 0.00 MB/s Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8a949-d010-4aa3-a2db-92792fca3b6a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-21ce7090-0bd3-4566-8ab5-f52e48b4ac21" released by "_delete_snapshot" :: held 1.722s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:38 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 1G Jul 20 16:58:38 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-a2cc3892-f733-4e97-a54d-cc76ba400a9b" released by "delete_snapshot" :: held 1.767s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Created reservations ['6b7f1ac8-395f-4dc5-b436-1ecf08817c9b', '4563005b-ba31-4065-8b95-7eec5336ac16', '08721de0-55e5-4ac2-bc8f-0ac49a78a9b7', 'a3c1cd13-c93c-4a53-87c5-d93e89ceb228'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:39 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 Jul 20 16:58:39 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Delete snapshot completed successfully. Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8c5d6f00-f430-4891-a9ef-5c7bd663305c tempest-VolumeDependencyTests-898535217 None] Lock "cinder-21ce7090-0bd3-4566-8ab5-f52e48b4ac21-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:39 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:39 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Flow 'volume_create_manager' (ee670c03-070a-4efd-b12c-d011efdb74ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6d8818-6697-48f4-b046-097c2e54c028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-a2cc3892-f733-4e97-a54d-cc76ba400a9b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6d8818-6697-48f4-b046-097c2e54c028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-136284606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ead850b-a73e-488e-9f0b-ffbd18650499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e3fa8f2514199a7d4c8dcdc2c9814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:39Z,use_quota=True,user_id='b11f6aa6f2ff4249b296498eabf2f554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:39 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc62d28-9136-4681-816e-aaa2b73df74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc62d28-9136-4681-816e-aaa2b73df74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabe6cf9-30f2-45f3-ada3-ba9fa905a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:39 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabe6cf9-30f2-45f3-ada3-ba9fa905a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ead850b-a73e-488e-9f0b-ffbd18650499', 'volume_name': 'volume-5ead850b-a73e-488e-9f0b-ffbd18650499', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528d1c90-20ba-404f-9c1e-48fa039b8104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528d1c90-20ba-404f-9c1e-48fa039b8104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ee2d1d-5a9d-46e8-9bb1-19c732cd84cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:39 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Volume 5ead850b-a73e-488e-9f0b-ffbd18650499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ead850b-a73e-488e-9f0b-ffbd18650499', 'volume_size': 1} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 1G" returned: 0 in 0.610s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07" returned: 0 in 0.586s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Downloaded image 29eac145-a2db-47da-8004-2fab9bc7b556 ((None, [{'url': 'file:///opt/stack/data/glance/images/29eac145-a2db-47da-8004-2fab9bc7b556', 'metadata': {}}])) to volume f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 successfully. {{(pid=87535) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Temporary image 29eac145-a2db-47da-8004-2fab9bc7b556 for user 646c8f257c1347dea785859950acfacb is deleted. {{(pid=87535) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.volume_utils [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Marking volume f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 as bootable. {{(pid=87535) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-a2cc3892-f733-4e97-a54d-cc76ba400a9b-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Copying metadata from image 29eac145-a2db-47da-8004-2fab9bc7b556 to f7a6d32b-f0a4-46ff-8e4f-f22f976e3553. {{(pid=87535) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Creating volume glance metadata for volume f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 backed by image 29eac145-a2db-47da-8004-2fab9bc7b556 with: {'image_id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9d86c45dee7308f3b3a03465fe2897ef', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87535) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 20 16:58:39 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 1G Jul 20 16:58:39 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:39 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-quobyte-a2cc3892-f733-4e97-a54d-cc76ba400a9b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-a2cc3892-f733-4e97-a54d-cc76ba400a9b" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb39b9-3213-4d6c-990b-e2dc52b2f836]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6674401a-4953-4994-ae53-e2db674f89f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553', 'volume_size': 1, 'image_id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29eac145-a2db-47da-8004-2fab9bc7b556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d86c45dee7308f3b3a03465fe2897ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b10ce3befe524ca093c12227c11bdc89', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c1840238f91f11c242e070edaae4fd1c254d40494832364d09ea634ad6a97dd74b42070808edd540f0e811191309d312331c38440adcd698478f5df534e10d9e', 'id': '29eac145-a2db-47da-8004-2fab9bc7b556', 'created_at': datetime.datetime(2026, 7, 20, 14, 58, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 20, 14, 58, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29eac145-a2db-47da-8004-2fab9bc7b556/file', 'properties': {}}, 'image_service': }' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4eee8a-54bc-4d85-9207-d598416de9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:39 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Volume volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 (f7a6d32b-f0a4-46ff-8e4f-f22f976e3553): created successfully Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4eee8a-54bc-4d85-9207-d598416de9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Flow 'volume_create_manager' (a44f7f31-fc4d-4ab5-9004-d454f0ea430f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-84a303e9-c710-41c0-8e5b-05a0f9d01895 tempest-VolumeImageDependencyTests-1156281906 None] Created volume successfully. Jul 20 16:58:39 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:39 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:39 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 1G" returned: 0 in 0.472s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 Jul 20 16:58:40 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b Jul 20 16:58:40 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094" returned: 0 in 0.331s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:40 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 is being set with open permissions: ugo+rw Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 Jul 20 16:58:40 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a2cc3892-f733-4e97-a54d-cc76ba400a9b" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-a2cc3892-f733-4e97-a54d-cc76ba400a9b" released by "delete_volume" :: held 0.776s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Created reservations ['0ab4fa80-60cc-48f7-aeef-e91a6b438c0a', '8a616333-d77b-4832-9ae7-805b40859819', '8ff3c8be-dfae-48ba-a141-38d3921b8069', 'b281089b-0966-404e-aa6b-4fb29c4def2a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Acquiring lock "cinder-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Lock "cinder-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Acquiring lock "cinder-quobyte-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Lock "cinder-quobyte-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" acquired by "delete_volume" :: waited 0.048s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:40 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:40 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094" returned: 0 in 0.319s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-f34ecf08-fe08-435c-a3d9-ffebc0fbd868-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f752ef-2187-4e96-9258-4e43bff77751]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-f34ecf08-fe08-435c-a3d9-ffebc0fbd868-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info Jul 20 16:58:40 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "cinder-quobyte-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f482d3-d482-42b5-883d-8b30781c0806]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:40 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 Jul 20 16:58:40 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.322s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:40 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Deleted volume successfully. Jul 20 16:58:40 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9fd95294-119a-4275-abc4-f7b23d3a5588 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-a2cc3892-f733-4e97-a54d-cc76ba400a9b-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:40 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 Jul 20 16:58:40 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:40 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info is being set with open permissions: ugo+rw Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:41 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info Jul 20 16:58:41 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:41 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" returned: 0 in 0.457s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:41 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553 Jul 20 16:58:41 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:41 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" returned: 0 in 0.412s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:41 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868 Jul 20 16:58:41 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:41 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.info" returned: 0 in 0.274s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-136284606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ead850b-a73e-488e-9f0b-ffbd18650499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e3fa8f2514199a7d4c8dcdc2c9814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:39Z,use_quota=True,user_id='b11f6aa6f2ff4249b296498eabf2f554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Creating volume 5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:41 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:41 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 1073741824 Jul 20 16:58:41 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f5ad591c-e5fe-4130-a548-87651e377f4f tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:58:41 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Lock "cinder-quobyte-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553" released by "delete_volume" :: held 0.807s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Created reservations ['9b35a3bf-0503-449a-ba9c-9d970781ad72', 'dbc388f1-585d-4511-8046-8251ad099735', '0114088e-cd11-48e3-b1f5-34539b0b771d', '768ec8eb-49f1-42f8-8669-f1448f9f10fb'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:41 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" returned: 0 in 0.313s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-quobyte-f34ecf08-fe08-435c-a3d9-ffebc0fbd868" released by "delete_volume" :: held 0.776s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:41 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Created reservations ['35b135d6-4443-458a-bb6b-a4e0ccb816fc', '2c84cfce-6d95-4572-a1d7-1789c22318ae', '52644e11-50a5-4b8d-ab77-9e0df62bda8a', '19dc531f-51e2-425d-b30e-7a195adbbf73'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:41 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:41 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:41 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.327s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Deleted volume successfully. Jul 20 16:58:41 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 1073741824" returned: 0 in 0.581s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-2c3d475f-2326-4dd9-a90c-78f6c803c3fb tempest-VolumeImageDependencyTests-1156281906 None] Lock "cinder-f7a6d32b-f0a4-46ff-8e4f-f22f976e3553-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:42 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 Jul 20 16:58:42 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-e200ca17-89c9-43ac-bf2f-13ff2e657094-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Lock "cinder-e200ca17-89c9-43ac-bf2f-13ff2e657094-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-cf2b48bb-f6a0-44b9-8047-5afe94519c07" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-cf2b48bb-f6a0-44b9-8047-5afe94519c07" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-e200ca17-89c9-43ac-bf2f-13ff2e657094" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-e200ca17-89c9-43ac-bf2f-13ff2e657094" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:42 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot e200ca17-89c9-43ac-bf2f-13ff2e657094 of volume cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.405s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb21cc8-225d-4696-ac99-edcbfaa9338c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Deleted volume successfully. Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bf6e77eb-d8ac-494a-9e0b-475e755ae294 tempest-VolumeDependencyTests-898535217 None] Lock "cinder-f34ecf08-fe08-435c-a3d9-ffebc0fbd868-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:42 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 Jul 20 16:58:42 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:42 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499" returned: 0 in 0.375s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ee2d1d-5a9d-46e8-9bb1-19c732cd84cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ead850b-a73e-488e-9f0b-ffbd18650499', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94156ef0-fabb-438c-9e24-0cd8c4ceb275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:42 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Volume volume-5ead850b-a73e-488e-9f0b-ffbd18650499 (5ead850b-a73e-488e-9f0b-ffbd18650499): created successfully Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94156ef0-fabb-438c-9e24-0cd8c4ceb275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Flow 'volume_create_manager' (ee670c03-070a-4efd-b12c-d011efdb74ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:42 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-569c977e-7c89-4cc3-9920-01364b0de59e tempest-CinderUnicodeTest-743745662 None] Created volume successfully. Jul 20 16:58:42 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094" returned: 0 in 0.466s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a530a1-8b71-46a2-9640-e85d554f82aa]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:42 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 Jul 20 16:58:42 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:43 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07" returned: 0 in 0.477s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:43 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 Jul 20 16:58:43 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:43 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094" returned: 0 in 0.477s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:43 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094 Jul 20 16:58:43 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:43 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07.e200ca17-89c9-43ac-bf2f-13ff2e657094" returned: 0 in 0.303s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=301,cinder:SELECT=203,cinder:INSERT=69,cinder:DELETE=27 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=214,cinder:INSERT=83,cinder:UPDATE=271,cinder:DELETE=26 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-e200ca17-89c9-43ac-bf2f-13ff2e657094" released by "_delete_snapshot" :: held 1.882s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-cf2b48bb-f6a0-44b9-8047-5afe94519c07" released by "delete_snapshot" :: held 1.921s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Creating offline snapshot b263cd9d-d5cc-4e98-a3c6-7649468fa744 of volume 5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ce0c4-6a63-46d9-80d3-50107450fa45]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Created reservations ['5a93a985-8d80-4c26-895c-fce51fa1f9d8', '5111551f-8e2c-45dc-a93f-64a5ee74950c', '49ef7dc0-7c0d-4834-b75e-3bf61dffe326', '778e7f06-c33e-4447-9e61-573230ca9faa'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:44 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 Jul 20 16:58:44 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:44 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d2465a26-73e9-473e-86b4-8c50eef4096c tempest-ProjectMemberTests-1121326326 None] Lock "cinder-e200ca17-89c9-43ac-bf2f-13ff2e657094-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:44 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499" returned: 0 in 0.434s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:44 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 1G Jul 20 16:58:44 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:45 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 1G" returned: 0 in 0.506s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ead850b-a73e-488e-9f0b-ffbd18650499 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:45 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ead850b-a73e-488e-9f0b-ffbd18650499 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 Jul 20 16:58:45 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:45 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-cf2b48bb-f6a0-44b9-8047-5afe94519c07-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ead850b-a73e-488e-9f0b-ffbd18650499 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744" returned: 0 in 0.365s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:45 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 is being set with open permissions: ugo+rw Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-cf2b48bb-f6a0-44b9-8047-5afe94519c07-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:45 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 Jul 20 16:58:45 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-cf2b48bb-f6a0-44b9-8047-5afe94519c07" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-cf2b48bb-f6a0-44b9-8047-5afe94519c07" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4073973b-cba8-405c-93c0-336ac37d8845]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:45 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744" returned: 0 in 0.305s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:45 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 Jul 20 16:58:45 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:45 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info Jul 20 16:58:45 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:46 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07" returned: 0 in 0.497s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:46 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info" returned: 0 in 0.341s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:46 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info is being set with open permissions: ugo+rw Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:46 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07 Jul 20 16:58:46 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:46 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info Jul 20 16:58:46 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04b31531-280a-4613-a8dd-aef931a8c304 tempest-ProjectAdminTests-1656053039 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87535) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 20 16:58:46 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-cf2b48bb-f6a0-44b9-8047-5afe94519c07" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-cf2b48bb-f6a0-44b9-8047-5afe94519c07" released by "delete_volume" :: held 0.884s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:46 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.info" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-6e9ff708-0c0a-4fbe-8933-c7857e98347c tempest-CinderUnicodeTest-743745662 None] Create snapshot completed successfully Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Created reservations ['f6522864-23bd-4706-ba4d-5db1c211eaa9', '89177571-97b8-42ee-8181-06a7d636d70a', '58689cdb-0294-4185-8157-fd366f648acb', 'fe98bbe0-05e7-47fc-98c5-ffa2c9ce2dd1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:46 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:46 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:46 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.341s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:46 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:58:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c5526eab-f22e-4833-8357-5c6574cbf6c9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-cf2b48bb-f6a0-44b9-8047-5afe94519c07-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-b263cd9d-d5cc-4e98-a3c6-7649468fa744-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (1749f414-46db-48e8-a1db-204c8651f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2927219-8cc9-4a34-8288-f4cd6feac1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-b263cd9d-d5cc-4e98-a3c6-7649468fa744-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-quobyte-5ead850b-a73e-488e-9f0b-ffbd18650499" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2927219-8cc9-4a34-8288-f4cd6feac1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940480011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9389798b-1bda-45f3-8ea3-5ff95a2cac75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:47Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885fcca8-1409-44a5-a5f0-7d5712b66112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885fcca8-1409-44a5-a5f0-7d5712b66112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a65273-dc76-4bf6-8824-ab146a227a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a65273-dc76-4bf6-8824-ab146a227a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9389798b-1bda-45f3-8ea3-5ff95a2cac75', 'volume_name': 'volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3056a49-2bef-4ba0-87a7-04720e84fe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3056a49-2bef-4ba0-87a7-04720e84fe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b4b1d3-56bc-4773-b76f-63072d68f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:47 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Volume 9389798b-1bda-45f3-8ea3-5ff95a2cac75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75', 'volume_size': 1} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940480011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9389798b-1bda-45f3-8ea3-5ff95a2cac75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:47Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Creating volume 9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:47 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:47 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 1073741824 Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-5ead850b-a73e-488e-9f0b-ffbd18650499" acquired by "delete_snapshot" :: waited 0.096s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-quobyte-b263cd9d-d5cc-4e98-a3c6-7649468fa744" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:47 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-b263cd9d-d5cc-4e98-a3c6-7649468fa744" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Deleting offline snapshot b263cd9d-d5cc-4e98-a3c6-7649468fa744 of volume 5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] snapshot_file for this snap is: volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23c50f-57e0-408d-82b4-194eb3bb7eb9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:47 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 Jul 20 16:58:47 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:47 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 1073741824" returned: 0 in 0.567s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:48 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744" returned: 0 in 0.528s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ead850b-a73e-488e-9f0b-ffbd18650499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47500b1-9ffe-404e-b533-580156d993de]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:48 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 Jul 20 16:58:48 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:48 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 Jul 20 16:58:48 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:48 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75" returned: 0 in 0.322s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b4b1d3-56bc-4773-b76f-63072d68f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd74c9b7-22d4-4caa-8a5a-3a0a8e5a5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:48 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Volume volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 (9389798b-1bda-45f3-8ea3-5ff95a2cac75): created successfully Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd74c9b7-22d4-4caa-8a5a-3a0a8e5a5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (1749f414-46db-48e8-a1db-204c8651f654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:48 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a0d26152-45f2-4155-9a3a-b27514453959 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:58:48 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499" returned: 0 in 0.487s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:48 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:48 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 Jul 20 16:58:48 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:49 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744" returned: 0 in 0.432s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:49 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744 Jul 20 16:58:49 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:49 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499.b263cd9d-d5cc-4e98-a3c6-7649468fa744" returned: 0 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-b263cd9d-d5cc-4e98-a3c6-7649468fa744" released by "_delete_snapshot" :: held 1.995s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-5ead850b-a73e-488e-9f0b-ffbd18650499" released by "delete_snapshot" :: held 2.030s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Created reservations ['fd90905b-ba6c-43af-b581-b3e433462b93', '28f8861f-0de4-459c-9855-8198f3cb0564', '42428a21-60fa-4972-be2d-bc74df6acc86', '45fa0e3b-7a00-4f5f-b5ae-ed236055dd1c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot 5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 of volume 9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[759bde1d-2922-461d-b563-5729d97b1ef7]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:49 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Delete snapshot completed successfully. Jul 20 16:58:49 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c2f82779-84f5-4286-9432-6124b28a0c41 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-b263cd9d-d5cc-4e98-a3c6-7649468fa744-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:49 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 Jul 20 16:58:49 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:50 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75" returned: 0 in 0.423s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:50 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 1G Jul 20 16:58:50 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-5ead850b-a73e-488e-9f0b-ffbd18650499-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-5ead850b-a73e-488e-9f0b-ffbd18650499-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:50 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 1G" returned: 0 in 0.494s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:50 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 Jul 20 16:58:50 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-quobyte-5ead850b-a73e-488e-9f0b-ffbd18650499" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-5ead850b-a73e-488e-9f0b-ffbd18650499" acquired by "delete_volume" :: waited 0.032s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3362641-891f-4631-958c-caca7372da26]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:50 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 Jul 20 16:58:50 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:50 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" returned: 0 in 0.393s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:50 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 is being set with open permissions: ugo+rw Jul 20 16:58:50 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:51 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 Jul 20 16:58:51 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:51 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499" returned: 0 in 0.448s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:51 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499 Jul 20 16:58:51 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:51 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" returned: 0 in 0.352s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:51 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info Jul 20 16:58:51 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:51 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-5ead850b-a73e-488e-9f0b-ffbd18650499" returned: 0 in 0.309s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-5ead850b-a73e-488e-9f0b-ffbd18650499" released by "delete_volume" :: held 0.849s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Created reservations ['e176b389-18f6-4e37-b330-976d90efc61e', '70c10a09-8dfa-4c24-9172-11e5e30e029a', 'b03db782-6cd4-4b41-86bf-7801db79cbe5', 'c2521e96-2abd-417d-beef-f0c899b02cd9'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (f6951a59-4411-482c-91e3-a0982f7cdcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07cf18a-e256-411e-993b-5f76876cd29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07cf18a-e256-411e-993b-5f76876cd29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388093140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55ca7dd-a45a-43f6-b34e-94a55cfcc789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:52Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccec5fd8-de6c-4c83-9d3d-26b2baebc7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccec5fd8-de6c-4c83-9d3d-26b2baebc7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907e81d8-54fb-4d57-9314-ab6e5d93ce89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907e81d8-54fb-4d57-9314-ab6e5d93ce89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55ca7dd-a45a-43f6-b34e-94a55cfcc789', 'volume_name': 'volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea931d70-8cd8-4aa0-a6b7-9c20b7af665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea931d70-8cd8-4aa0-a6b7-9c20b7af665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4be7a22-47d7-4c4b-a562-984c4bc6de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:51 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Volume d55ca7dd-a45a-43f6-b34e-94a55cfcc789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789', 'volume_size': 1} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:51 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info" returned: 0 in 0.358s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:51 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info is being set with open permissions: ugo+rw Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:51 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info Jul 20 16:58:51 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:51 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:51 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:51 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:51 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.info" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388093140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55ca7dd-a45a-43f6-b34e-94a55cfcc789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:52Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Creating volume d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:52 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.304s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:52 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 1073741824 Jul 20 16:58:52 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Deleted volume successfully. Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-7b5b7c09-4a55-46fa-9561-918a81ac8902 tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ac1c5b5-3e88-4c5f-b506-e68fe875a710 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-5ead850b-a73e-488e-9f0b-ffbd18650499-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Flow 'volume_create_manager' (c0757a3e-eaa6-4023-ad9b-c7879198f2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee17805-a151-40f9-8f0c-bd877e1c0cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee17805-a151-40f9-8f0c-bd877e1c0cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493664285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd37c7ca-9859-4233-937a-ca7716ca66e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445af57094ad468f8bff3c46397ab7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:52Z,use_quota=True,user_id='18ed49f0b89d4976ab9c2a22d0e8d6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f9ceb-0e7d-4eb5-a399-a7844a1960e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f9ceb-0e7d-4eb5-a399-a7844a1960e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c74985-c4b8-42c0-b79b-34a9c4e5fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c74985-c4b8-42c0-b79b-34a9c4e5fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd37c7ca-9859-4233-937a-ca7716ca66e6', 'volume_name': 'volume-bd37c7ca-9859-4233-937a-ca7716ca66e6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d210dc9-c9cf-4e94-a8c0-7e9e827d43d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d210dc9-c9cf-4e94-a8c0-7e9e827d43d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ceeef6-f3ed-4aad-a846-c90c282dd67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Volume bd37c7ca-9859-4233-937a-ca7716ca66e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd37c7ca-9859-4233-937a-ca7716ca66e6', 'volume_size': 1} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:52 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 1073741824" returned: 0 in 0.465s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:52 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 Jul 20 16:58:52 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:52 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493664285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd37c7ca-9859-4233-937a-ca7716ca66e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445af57094ad468f8bff3c46397ab7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:52Z,use_quota=True,user_id='18ed49f0b89d4976ab9c2a22d0e8d6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Creating volume bd37c7ca-9859-4233-937a-ca7716ca66e6 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-d9742ab0-528a-4359-95db-01c00e83c523-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-5ff83a8a-db0e-417c-8b64-5a6d55cb9d66-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:52 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 1073741824 Jul 20 16:58:52 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4be7a22-47d7-4c4b-a562-984c4bc6de45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5260438e-5090-4e31-afb6-6a8ba95829af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-d9742ab0-528a-4359-95db-01c00e83c523-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-5ff83a8a-db0e-417c-8b64-5a6d55cb9d66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-9389798b-1bda-45f3-8ea3-5ff95a2cac75" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Volume volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 (d55ca7dd-a45a-43f6-b34e-94a55cfcc789): created successfully Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5260438e-5090-4e31-afb6-6a8ba95829af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (f6951a59-4411-482c-91e3-a0982f7cdcaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-9389798b-1bda-45f3-8ea3-5ff95a2cac75" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:52 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:52 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-39b77d69-38b8-42ff-b9d1-d56bac8e39a8 tempest-ProjectReaderTests-916422338 None] Created volume successfully. Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "cinder-quobyte-d9742ab0-528a-4359-95db-01c00e83c523" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot 5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 of volume 9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-d9742ab0-528a-4359-95db-01c00e83c523" acquired by "delete_volume" :: waited 0.044s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[46276790-855c-40ea-a043-a697732dfd6b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1584784-49f3-4e7c-9f41-254133fea4e4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:53 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 Jul 20 16:58:53 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:53 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 Jul 20 16:58:53 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:53 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 1073741824" returned: 0 in 0.528s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:53 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 Jul 20 16:58:53 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:53 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" returned: 0 in 0.403s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:53 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523" returned: 0 in 0.421s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8becf408-0b56-4165-bb7e-62cb15039d62]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:53 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523 Jul 20 16:58:53 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:53 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 Jul 20 16:58:53 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:53 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ceeef6-f3ed-4aad-a846-c90c282dd67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd37c7ca-9859-4233-937a-ca7716ca66e6', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bed89f-a752-494b-be8e-d615e28ce9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:53 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d9742ab0-528a-4359-95db-01c00e83c523" returned: 0 in 0.292s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:53 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Volume volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 (bd37c7ca-9859-4233-937a-ca7716ca66e6): created successfully Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bed89f-a752-494b-be8e-d615e28ce9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Flow 'volume_create_manager' (c0757a3e-eaa6-4023-ad9b-c7879198f2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-quobyte-d9742ab0-528a-4359-95db-01c00e83c523" released by "delete_volume" :: held 0.786s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:53 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cb5363df-7bfe-4d44-a568-899f40700d5b tempest-ProjectReaderTests-408371298 None] Created volume successfully. Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Creating offline snapshot 6acf3b19-db7b-4559-b1c4-227f874b5cb0 of volume d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1728fe-8ec6-4b9f-896f-5086e9942557]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:53 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Created reservations ['fc95b11e-2dbf-4ece-abef-fb3f07795272', 'e1a97992-a7f6-4ca9-af1a-745c50c5395c', '652334e4-2c4d-4517-af0c-c67391bbd952', '5337a2e9-d5b1-4cd7-9ad2-c674095d7f86'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:53 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75" returned: 0 in 0.483s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:54 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 Jul 20 16:58:54 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:54 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:54 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:54 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 Jul 20 16:58:54 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:54 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.320s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:54 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Deleted volume successfully. Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1dc276d3-0a23-4f95-b435-2cac8f4b5595 tempest-CinderUnicodeTest-743745662 None] Lock "cinder-d9742ab0-528a-4359-95db-01c00e83c523-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:54 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" returned: 0 in 0.498s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:54 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" returned: 0 in 0.435s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:54 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 1G Jul 20 16:58:54 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:54 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66 Jul 20 16:58:54 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:54 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Acquiring lock "cinder-bd37c7ca-9859-4233-937a-ca7716ca66e6-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75.5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" returned: 0 in 0.295s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-5ff83a8a-db0e-417c-8b64-5a6d55cb9d66" released by "_delete_snapshot" :: held 1.759s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-9389798b-1bda-45f3-8ea3-5ff95a2cac75" released by "delete_snapshot" :: held 1.802s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Lock "cinder-bd37c7ca-9859-4233-937a-ca7716ca66e6-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Acquiring lock "cinder-quobyte-bd37c7ca-9859-4233-937a-ca7716ca66e6" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Lock "cinder-quobyte-bd37c7ca-9859-4233-937a-ca7716ca66e6" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb26db-cd37-412d-9e15-6379c202393b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Created reservations ['90b726e9-5d02-47ca-996f-3d00cbf969d8', 'b81ed228-bb55-437e-846e-d0b3041e8a98', '02e9cb80-dccb-4a4b-a35b-6b1f41ce0824', '9f555f41-b44f-4e3a-99d7-1ae74f035744'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:54 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 1G" returned: 0 in 0.575s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:54 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 Jul 20 16:58:55 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 Jul 20 16:58:55 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1b053cc1-451c-4d56-b2ce-41b31a4cd0c0 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-5ff83a8a-db0e-417c-8b64-5a6d55cb9d66-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-9389798b-1bda-45f3-8ea3-5ff95a2cac75-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-9389798b-1bda-45f3-8ea3-5ff95a2cac75-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-9389798b-1bda-45f3-8ea3-5ff95a2cac75" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-9389798b-1bda-45f3-8ea3-5ff95a2cac75" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5a8a5f-3d48-40c1-ba9b-3e8a651c9e78]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6" returned: 0 in 0.463s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6 Jul 20 16:58:55 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0" returned: 0 in 0.422s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:55 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 is being set with open permissions: ugo+rw Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 Jul 20 16:58:55 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 Jul 20 16:58:55 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-bd37c7ca-9859-4233-937a-ca7716ca66e6" returned: 0 in 0.305s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Lock "cinder-quobyte-bd37c7ca-9859-4233-937a-ca7716ca66e6" released by "delete_volume" :: held 0.824s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:55 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Created reservations ['e00a3261-14a5-4cd3-b77f-5441dc4a7ff8', '71252834-3fb1-4f07-998e-877c876507b0', '9e45eff7-3411-45d5-a9ce-1429103940c0', '6d448566-619c-443c-9af9-f32ca282f094'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:55 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75" returned: 0 in 0.466s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75 Jul 20 16:58:55 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info Jul 20 16:58:55 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:55 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:55 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:55 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:56 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9389798b-1bda-45f3-8ea3-5ff95a2cac75" returned: 0 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-9389798b-1bda-45f3-8ea3-5ff95a2cac75" released by "delete_volume" :: held 0.882s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:56 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info" returned: 0 in 0.399s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:56 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info is being set with open permissions: ugo+rw Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:56 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.293s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:56 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info Jul 20 16:58:56 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Deleted volume successfully. Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Created reservations ['d364a25f-0baa-4288-8956-4f2ab45cd5ef', 'd370da13-cad3-42ca-bdbf-9a0fc016b6ab', 'ae02e3f6-0fe7-4593-8aa7-f05a8e66d750', '27cdf335-8f63-4b02-8d93-02a0a707b484'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-daa3ccfd-fbd7-4f81-8068-af563017810e tempest-ProjectReaderTests-408371298 None] Lock "cinder-bd37c7ca-9859-4233-937a-ca7716ca66e6-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:56 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:56 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:56 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.info" returned: 0 in 0.324s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8ab92b5e-df60-42b2-a5ec-7871a5e87693 tempest-ProjectReaderTests-916422338 None] Create snapshot completed successfully Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Flow 'volume_create_manager' (69df8662-50b8-46cf-8d28-8958f91fe464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0ceadb-7fc6-4669-a16f-42d6b14ddfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0ceadb-7fc6-4669-a16f-42d6b14ddfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1261484051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65d6863-48b5-4596-a7d2-a1d416e556f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445af57094ad468f8bff3c46397ab7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:57Z,use_quota=True,user_id='18ed49f0b89d4976ab9c2a22d0e8d6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e51f4-7eba-4d3a-bbbb-77fedb2020bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e51f4-7eba-4d3a-bbbb-77fedb2020bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc1837d-a389-4eb7-a8ad-7077aa17b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:56 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc1837d-a389-4eb7-a8ad-7077aa17b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65d6863-48b5-4596-a7d2-a1d416e556f1', 'volume_name': 'volume-a65d6863-48b5-4596-a7d2-a1d416e556f1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff30640-dbfe-43c3-bfde-5e841a4662e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff30640-dbfe-43c3-bfde-5e841a4662e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59a5f5f-3b62-4ad1-9039-edbd70fc4ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:56 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Volume a65d6863-48b5-4596-a7d2-a1d416e556f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65d6863-48b5-4596-a7d2-a1d416e556f1', 'volume_size': 1} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1261484051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65d6863-48b5-4596-a7d2-a1d416e556f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445af57094ad468f8bff3c46397ab7c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:57Z,use_quota=True,user_id='18ed49f0b89d4976ab9c2a22d0e8d6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Creating volume a65d6863-48b5-4596-a7d2-a1d416e556f1 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:56 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.368s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:58:56 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:58:56 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 1073741824 Jul 20 16:58:56 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:56 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b88ad070-158e-427c-8d30-9bff7e70b888 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-9389798b-1bda-45f3-8ea3-5ff95a2cac75-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:57 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 1073741824" returned: 0 in 0.506s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-6acf3b19-db7b-4559-b1c4-227f874b5cb0-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Lock "cinder-6acf3b19-db7b-4559-b1c4-227f874b5cb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:57 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 Jul 20 16:58:57 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-6acf3b19-db7b-4559-b1c4-227f874b5cb0" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-6acf3b19-db7b-4559-b1c4-227f874b5cb0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Deleting offline snapshot 6acf3b19-db7b-4559-b1c4-227f874b5cb0 of volume d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] snapshot_file for this snap is: volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1768eb87-375f-43c2-a710-e0ee245e5a01]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:57 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 Jul 20 16:58:57 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:57 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1" returned: 0 in 0.395s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59a5f5f-3b62-4ad1-9039-edbd70fc4ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65d6863-48b5-4596-a7d2-a1d416e556f1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f6f640-2ceb-4e22-8319-6730e667ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:57 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Volume volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 (a65d6863-48b5-4596-a7d2-a1d416e556f1): created successfully Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f6f640-2ceb-4e22-8319-6730e667ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Flow 'volume_create_manager' (69df8662-50b8-46cf-8d28-8958f91fe464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:57 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9ae74fa8-3ac7-42c5-b775-8e19f2f80439 tempest-ProjectReaderTests-408371298 None] Created volume successfully. Jul 20 16:58:57 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0" returned: 0 in 0.512s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef4bab8-86b4-4103-bd3a-ea72aa22344b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:57 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (fe177af3-5c93-4cc1-8c78-a845a2b65f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48b8943-6350-4479-8953-705ed25896cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48b8943-6350-4479-8953-705ed25896cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494014280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124407f3-8637-4c10-b14e-82bd2bdeb11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:58Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:58 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 Jul 20 16:58:58 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0f7731-f485-4461-8656-4b98bbbdd883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0f7731-f485-4461-8656-4b98bbbdd883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2665dd5d-9d11-4b39-9db1-965dd0f11b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2665dd5d-9d11-4b39-9db1-965dd0f11b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124407f3-8637-4c10-b14e-82bd2bdeb11b', 'volume_name': 'volume-124407f3-8637-4c10-b14e-82bd2bdeb11b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0a8b2b-283b-4a6e-b2d9-63ed4b249fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0a8b2b-283b-4a6e-b2d9-63ed4b249fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775731e5-5e44-41b0-bb37-2edd4ba43aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:58 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Volume 124407f3-8637-4c10-b14e-82bd2bdeb11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124407f3-8637-4c10-b14e-82bd2bdeb11b', 'volume_size': 1} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494014280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124407f3-8637-4c10-b14e-82bd2bdeb11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:58:58Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Creating volume 124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:58:58 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:58 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b 1073741824 Jul 20 16:58:58 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:58 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" returned: 0 in 0.425s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:58 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 Jul 20 16:58:58 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:58 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b 1073741824" returned: 0 in 0.502s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:58 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b Jul 20 16:58:58 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Acquiring lock "cinder-a65d6863-48b5-4596-a7d2-a1d416e556f1-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Lock "cinder-a65d6863-48b5-4596-a7d2-a1d416e556f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:58 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0" returned: 0 in 0.456s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:58 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0 Jul 20 16:58:58 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Acquiring lock "cinder-quobyte-a65d6863-48b5-4596-a7d2-a1d416e556f1" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Lock "cinder-quobyte-a65d6863-48b5-4596-a7d2-a1d416e556f1" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c712ed4f-13fd-4e6d-a955-4c1b1e26045d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:58 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:59 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b" returned: 0 in 0.367s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775731e5-5e44-41b0-bb37-2edd4ba43aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124407f3-8637-4c10-b14e-82bd2bdeb11b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b058a05-4dd4-44ff-a9b4-12a868816ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:58:59 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Volume volume-124407f3-8637-4c10-b14e-82bd2bdeb11b (124407f3-8637-4c10-b14e-82bd2bdeb11b): created successfully Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b058a05-4dd4-44ff-a9b4-12a868816ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (fe177af3-5c93-4cc1-8c78-a845a2b65f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:58:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f708e753-73af-4881-b9f0-0e690d028244 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:58:59 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 Jul 20 16:58:59 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:59 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789.6acf3b19-db7b-4559-b1c4-227f874b5cb0" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-6acf3b19-db7b-4559-b1c4-227f874b5cb0" released by "_delete_snapshot" :: held 1.852s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" released by "delete_snapshot" :: held 1.893s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Created reservations ['123df94e-4f6f-4182-bf45-0dab236e7245', '77050844-bcd5-44ec-9adf-f7aca42ad14d', '4ff1b652-fad9-4d44-b5f0-51784d3b3fa4', 'e7476052-8a0b-483e-adf1-a916409fd633'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:59 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Delete snapshot completed successfully. Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1c415ac7-9f0b-44c5-a3e0-3fd4c677668f tempest-ProjectReaderTests-916422338 None] Lock "cinder-6acf3b19-db7b-4559-b1c4-227f874b5cb0-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:59 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1" returned: 0 in 0.449s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-d55ca7dd-a45a-43f6-b34e-94a55cfcc789-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:59 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1 Jul 20 16:58:59 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Lock "cinder-d55ca7dd-a45a-43f6-b34e-94a55cfcc789-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f4315b-1abb-48d6-9417-ded276bf01c5]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:59 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 Jul 20 16:58:59 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:58:59 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a65d6863-48b5-4596-a7d2-a1d416e556f1" returned: 0 in 0.311s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Lock "cinder-quobyte-a65d6863-48b5-4596-a7d2-a1d416e556f1" released by "delete_volume" :: held 0.838s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Created reservations ['38ccde80-c9d5-44b1-8e05-736c82ba9136', 'b776e083-d10c-4a2f-9326-9dcabb017557', '0601887e-cae1-4e5c-b0d2-b54433de896d', 'b0207212-7ddb-4f75-ac36-81f0b1ebbf56'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:58:59 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:58:59 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:58:59 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:00 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" returned: 0 in 0.484s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:00 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789 Jul 20 16:59:00 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:00 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:00 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Deleted volume successfully. Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-451adef3-057d-4d83-9c2b-e2e2093541a9 tempest-ProjectReaderTests-408371298 None] Lock "cinder-a65d6863-48b5-4596-a7d2-a1d416e556f1-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:00 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" returned: 0 in 0.434s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d55ca7dd-a45a-43f6-b34e-94a55cfcc789" released by "delete_volume" :: held 0.985s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot 899fcbfd-de47-4865-8f97-de9fac028add of volume 124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c30b8-843e-46c8-a45c-f5c9c7c7cc7c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Created reservations ['00fab3cf-7388-4257-aa91-958daf8fce89', 'f4e64f1c-fa71-4ce1-b727-ddea96b053b3', '603cd88e-644e-4c3c-87b8-9648aefecdee', '3a132c98-cf2b-4b44-ab48-60c042aeba4d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:00 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b Jul 20 16:59:00 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:00 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:00 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:00 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:01 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b" returned: 0 in 0.573s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:01 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.443s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:01 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add 1G Jul 20 16:59:01 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:01 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Deleted volume successfully. Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4461c019-b97f-4ec5-9fd3-be8d3c801ea5 tempest-ProjectReaderTests-916422338 None] Lock "cinder-d55ca7dd-a45a-43f6-b34e-94a55cfcc789-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:01 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add 1G" returned: 0 in 0.623s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:01 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124407f3-8637-4c10-b14e-82bd2bdeb11b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:01 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124407f3-8637-4c10-b14e-82bd2bdeb11b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add Jul 20 16:59:01 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:02 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124407f3-8637-4c10-b14e-82bd2bdeb11b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add" returned: 0 in 0.409s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:02 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add is being set with open permissions: ugo+rw Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:02 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add Jul 20 16:59:02 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (bf248102-6fdb-4733-98b9-d61fba0d3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5f5b0f-069e-4377-993b-a6ae2124f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:02 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add" returned: 0 in 0.315s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5f5b0f-069e-4377-993b-a6ae2124f973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891856548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9602f7fd-6548-4ecf-8f89-b6d015bfcfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:02Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0224c0d-c762-4194-b2e4-390c18366256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0224c0d-c762-4194-b2e4-390c18366256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139d8440-9be9-4ea2-b500-973cab5bf921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139d8440-9be9-4ea2-b500-973cab5bf921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9602f7fd-6548-4ecf-8f89-b6d015bfcfd1', 'volume_name': 'volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de3ecac-c2ab-4816-9615-91ef4f169208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de3ecac-c2ab-4816-9615-91ef4f169208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ec106c-8084-4322-bd82-87bdd2afab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:02 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Volume 9602f7fd-6548-4ecf-8f89-b6d015bfcfd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1', 'volume_size': 1} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:02 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info Jul 20 16:59:02 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:02 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:02 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info is being set with open permissions: ugo+rw Jul 20 16:59:02 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:02 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info Jul 20 16:59:02 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:03 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.info" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891856548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9602f7fd-6548-4ecf-8f89-b6d015bfcfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:02Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Creating volume 9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:03 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:03 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 1073741824 Jul 20 16:59:03 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:03 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0ac3406d-2a74-4b1c-bd6a-7302f3a6b499 tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:59:03 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 1073741824" returned: 0 in 0.465s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:03 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 Jul 20 16:59:03 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-899fcbfd-de47-4865-8f97-de9fac028add-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-899fcbfd-de47-4865-8f97-de9fac028add-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-124407f3-8637-4c10-b14e-82bd2bdeb11b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-124407f3-8637-4c10-b14e-82bd2bdeb11b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-899fcbfd-de47-4865-8f97-de9fac028add" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-899fcbfd-de47-4865-8f97-de9fac028add" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot 899fcbfd-de47-4865-8f97-de9fac028add of volume 124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[71114464-35d9-411a-936c-a444b3d982e9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:03 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add Jul 20 16:59:03 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:03 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" returned: 0 in 0.290s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ec106c-8084-4322-bd82-87bdd2afab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:03 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc903eb-dadf-4043-8c8d-5b68a65ad3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:04 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Volume volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 (9602f7fd-6548-4ecf-8f89-b6d015bfcfd1): created successfully Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc903eb-dadf-4043-8c8d-5b68a65ad3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (bf248102-6fdb-4733-98b9-d61fba0d3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:04 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-62571b89-feca-4c0a-be65-d3d74d856c50 tempest-ProjectReaderTests-916422338 None] Created volume successfully. Jul 20 16:59:04 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124407f3-8637-4c10-b14e-82bd2bdeb11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f189d3b4-2499-42f1-a6af-8ef97721bbdf]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:04 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b Jul 20 16:59:04 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Creating offline snapshot d7c0b26e-06c0-4e36-80c0-7791306b33ef of volume 9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265891a-b0ec-4ef8-8a3c-bee72d80bcf4]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:04 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b" returned: 0 in 0.412s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:04 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:04 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add Jul 20 16:59:04 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:04 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 Jul 20 16:59:04 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:05 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:05 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add" returned: 0 in 0.407s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" returned: 0 in 0.440s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:05 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add Jul 20 16:59:05 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:05 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef 1G Jul 20 16:59:05 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:05 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b.899fcbfd-de47-4865-8f97-de9fac028add" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-899fcbfd-de47-4865-8f97-de9fac028add" released by "_delete_snapshot" :: held 1.569s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-124407f3-8637-4c10-b14e-82bd2bdeb11b" released by "delete_snapshot" :: held 1.592s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Created reservations ['4301b1db-891c-42f6-b47c-c341da0217f5', '786672db-c252-4076-95ff-218b5db3e1ea', '9019e82f-0530-481a-8f2e-8f8dd2fd3615', 'e9835a8a-cb53-4172-af78-2b0d50ad0411'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:05 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-973e80da-13cc-4d71-b656-9a33fc7feee1 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-899fcbfd-de47-4865-8f97-de9fac028add-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:05 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef 1G" returned: 0 in 0.475s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:05 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef Jul 20 16:59:05 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:05 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:05 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef is being set with open permissions: ugo+rw Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-124407f3-8637-4c10-b14e-82bd2bdeb11b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:05 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef Jul 20 16:59:05 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:05 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Lock "cinder-124407f3-8637-4c10-b14e-82bd2bdeb11b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-124407f3-8637-4c10-b14e-82bd2bdeb11b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-124407f3-8637-4c10-b14e-82bd2bdeb11b" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3450df69-8205-4130-bbfb-b6d1e7f3c040]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:06 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:06 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b Jul 20 16:59:06 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:06 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info Jul 20 16:59:06 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:06 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:06 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b Jul 20 16:59:06 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:06 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info" returned: 0 in 0.314s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:06 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info is being set with open permissions: ugo+rw Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:06 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info Jul 20 16:59:06 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:06 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-124407f3-8637-4c10-b14e-82bd2bdeb11b" returned: 0 in 0.284s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-124407f3-8637-4c10-b14e-82bd2bdeb11b" released by "delete_volume" :: held 0.754s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:06 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.info" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:06 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-97e77566-c052-4552-b6c8-0c4019395e3b tempest-ProjectReaderTests-916422338 None] Create snapshot completed successfully Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Created reservations ['0b74a236-4153-4eb5-ac0f-f75751b36a90', '47cd5535-ec66-459d-99d4-3982043e4395', '5b68184a-8f1e-4c50-88ee-91a19e694468', 'c719e0cc-3487-4c6a-80d1-1818005d9da6'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:06 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:06 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:06 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:07 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.288s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:07 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-e0149cc3-c2ef-4d0b-9890-2f67170398ce tempest-ProjectMemberTests-1121326326 None] Lock "cinder-124407f3-8637-4c10-b14e-82bd2bdeb11b-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (6f64a90d-45b8-4ccf-8e91-28905425b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc7a541-882a-47c4-a88c-b41fbf482386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc7a541-882a-47c4-a88c-b41fbf482386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004270197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6771db-60d5-48e8-b18b-0c81689669fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:08Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8fe90-f43f-4be5-b662-ca53b8ec5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8fe90-f43f-4be5-b662-ca53b8ec5a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8544729-f5f1-4cca-91bf-5fc4fd7ddb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8544729-f5f1-4cca-91bf-5fc4fd7ddb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6771db-60d5-48e8-b18b-0c81689669fa', 'volume_name': 'volume-ae6771db-60d5-48e8-b18b-0c81689669fa', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faeed81f-c54f-46ba-9928-319e6288a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faeed81f-c54f-46ba-9928-319e6288a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b3a42-7718-4f21-afeb-b0e7d6c2f5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:07 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Volume ae6771db-60d5-48e8-b18b-0c81689669fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6771db-60d5-48e8-b18b-0c81689669fa', 'volume_size': 1} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004270197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6771db-60d5-48e8-b18b-0c81689669fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:08Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Creating volume ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:07 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:07 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa 1073741824 Jul 20 16:59:07 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-d7c0b26e-06c0-4e36-80c0-7791306b33ef-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Lock "cinder-d7c0b26e-06c0-4e36-80c0-7791306b33ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-d7c0b26e-06c0-4e36-80c0-7791306b33ef" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d7c0b26e-06c0-4e36-80c0-7791306b33ef" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Deleting offline snapshot d7c0b26e-06c0-4e36-80c0-7791306b33ef of volume 9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] snapshot_file for this snap is: volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e75fff-489d-4b28-816b-bd120f21239a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:07 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:08 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef Jul 20 16:59:08 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:08 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa 1073741824" returned: 0 in 0.530s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:08 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa Jul 20 16:59:08 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:08 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef" returned: 0 in 0.408s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[6391de3d-5708-4e1d-b7eb-4e55729240b9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:08 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 Jul 20 16:59:08 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:08 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa" returned: 0 in 0.287s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b3a42-7718-4f21-afeb-b0e7d6c2f5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6771db-60d5-48e8-b18b-0c81689669fa', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb582e53-2d98-4a77-a97b-76c2185b43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:08 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Volume volume-ae6771db-60d5-48e8-b18b-0c81689669fa (ae6771db-60d5-48e8-b18b-0c81689669fa): created successfully Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb582e53-2d98-4a77-a97b-76c2185b43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (6f64a90d-45b8-4ccf-8e91-28905425b877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:08 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e855e442-d58b-43ae-b656-20f848418641 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:59:08 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" returned: 0 in 0.383s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:08 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:08 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef Jul 20 16:59:08 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (1fd1f5b7-c643-49ac-bbdd-67888563949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d96722-29d1-46a0-b9ea-67f8c6a9daa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d96722-29d1-46a0-b9ea-67f8c6a9daa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144172628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50234200-adfa-4878-85fd-fa18df7b56df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:09Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed75f5e8-bf68-442f-ad3a-293189cc8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed75f5e8-bf68-442f-ad3a-293189cc8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170ba962-cf74-46a5-9d9b-85f00bb899f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170ba962-cf74-46a5-9d9b-85f00bb899f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50234200-adfa-4878-85fd-fa18df7b56df', 'volume_name': 'volume-50234200-adfa-4878-85fd-fa18df7b56df', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2ee0ef-0b56-4176-a9f3-37a60343d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2ee0ef-0b56-4176-a9f3-37a60343d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:09 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a151f86f-fdf7-419b-aedf-b6a6b2148096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Volume 50234200-adfa-4878-85fd-fa18df7b56df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50234200-adfa-4878-85fd-fa18df7b56df', 'volume_size': 1} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144172628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50234200-adfa-4878-85fd-fa18df7b56df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:09Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Creating volume 50234200-adfa-4878-85fd-fa18df7b56df {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:09 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:09 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df 1073741824 Jul 20 16:59:09 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:09 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef Jul 20 16:59:09 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:09 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1.d7c0b26e-06c0-4e36-80c0-7791306b33ef" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d7c0b26e-06c0-4e36-80c0-7791306b33ef" released by "_delete_snapshot" :: held 1.546s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" released by "delete_snapshot" :: held 1.573s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Created reservations ['e1834d02-f32b-4121-ae72-30c81ee649e7', 'a68b55f5-5108-405b-be6c-850591b9908c', 'e490b722-18fe-4ced-8f78-7e5486194047', '904463fe-4d08-468e-ab85-291c28f58df8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:09 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df 1073741824" returned: 0 in 0.414s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Delete snapshot completed successfully. Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-43e58af7-ff26-4511-ba83-9b01b4285b14 tempest-ProjectReaderTests-916422338 None] Lock "cinder-d7c0b26e-06c0-4e36-80c0-7791306b33ef-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:09 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df Jul 20 16:59:09 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:09 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a151f86f-fdf7-419b-aedf-b6a6b2148096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50234200-adfa-4878-85fd-fa18df7b56df', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82719ffe-268d-4254-8209-30ab22320ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot f8531be8-366f-47b5-9a34-1b20190ca705 of volume ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:09 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Volume volume-50234200-adfa-4878-85fd-fa18df7b56df (50234200-adfa-4878-85fd-fa18df7b56df): created successfully Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82719ffe-268d-4254-8209-30ab22320ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (1fd1f5b7-c643-49ac-bbdd-67888563949d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0537841-271f-437f-9f9c-5f1fde1d1038]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:09 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:09 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8625c6ab-1aa0-47a2-9b5b-cd1978d2edee tempest-ProjectReaderTests-1847092811 None] Created volume successfully. Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Lock "cinder-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:10 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa Jul 20 16:59:10 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" acquired by "delete_volume" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d8f199-f198-4f0b-8289-54fec0fb5fbb]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-50234200-adfa-4878-85fd-fa18df7b56df-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-50234200-adfa-4878-85fd-fa18df7b56df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:10 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-quobyte-50234200-adfa-4878-85fd-fa18df7b56df" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:10 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-50234200-adfa-4878-85fd-fa18df7b56df" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:10 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa" returned: 0 in 0.435s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[40251b1a-3de3-46d6-bb42-77025aae66c5]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:10 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 1G Jul 20 16:59:10 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df Jul 20 16:59:10 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" returned: 0 in 0.431s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:10 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1 Jul 20 16:59:10 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df" returned: 0 in 0.385s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:10 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df Jul 20 16:59:10 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 1G" returned: 0 in 0.436s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6771db-60d5-48e8-b18b-0c81689669fa -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:10 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6771db-60d5-48e8-b18b-0c81689669fa -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 Jul 20 16:59:10 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:10 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" returned: 0 in 0.294s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1" released by "delete_volume" :: held 0.793s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:10 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Created reservations ['b6c13726-6630-41e0-98ad-ac4a48fad01f', 'e587de98-42bf-4340-ab19-c49247b59d4f', '6da8321b-aaca-4f5c-954c-07f180852789', '860bac58-974c-43b3-b7e1-66e518e519de'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:11 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-50234200-adfa-4878-85fd-fa18df7b56df" returned: 0 in 0.280s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-50234200-adfa-4878-85fd-fa18df7b56df" released by "delete_volume" :: held 0.715s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:11 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:11 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Created reservations ['23af2678-b962-4f3d-ab96-57cf9d7c0a58', 'c8b49413-ab68-4c9a-8aa1-9490a345f037', '4bb290be-9fcb-4a46-ac6f-b87ba7027f6d', 'e91d8dda-ecbe-4e76-9901-e850ff210778'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:11 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae6771db-60d5-48e8-b18b-0c81689669fa -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705" returned: 0 in 0.375s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 is being set with open permissions: ugo+rw Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:11 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 Jul 20 16:59:11 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:11 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:11 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:11 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.321s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Deleted volume successfully. Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c621d93e-258c-46fd-9c99-592af0a419ab tempest-ProjectReaderTests-916422338 None] Lock "cinder-9602f7fd-6548-4ecf-8f89-b6d015bfcfd1-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:11 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705" returned: 0 in 0.300s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:11 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info Jul 20 16:59:11 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:11 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.383s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:11 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Deleted volume successfully. Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ae90c295-2b55-4c2f-9dfc-1e57e17ff969 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-50234200-adfa-4878-85fd-fa18df7b56df-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (2314bd05-8d96-4c8f-a39c-388d9cd69e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb85b427-5820-4574-93d0-0a11cf8ae5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb85b427-5820-4574-93d0-0a11cf8ae5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417887806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338d60c2-5135-4dcd-a3af-99ffb55f279b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:12Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871522d6-2ecd-45d6-bf76-0645dff5e728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871522d6-2ecd-45d6-bf76-0645dff5e728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381148b6-cd22-4922-8395-3be68c9ce11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381148b6-cd22-4922-8395-3be68c9ce11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338d60c2-5135-4dcd-a3af-99ffb55f279b', 'volume_name': 'volume-338d60c2-5135-4dcd-a3af-99ffb55f279b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea5421c-fe73-48ac-8c85-c9b58d54a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea5421c-fe73-48ac-8c85-c9b58d54a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b448994-27a1-4743-aee6-23d1016723f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:11 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Volume 338d60c2-5135-4dcd-a3af-99ffb55f279b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338d60c2-5135-4dcd-a3af-99ffb55f279b', 'volume_size': 1} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:11 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info" returned: 0 in 0.318s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:11 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info is being set with open permissions: ugo+rw Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:11 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info Jul 20 16:59:11 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:11 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (1a0493e9-db48-41ac-8dc2-ef9d8177bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79c9cbb-ae6d-4295-871f-cf64dc047315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79c9cbb-ae6d-4295-871f-cf64dc047315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-149973840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88a1c09-343b-4a6c-9752-01f310a52d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:12Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3d16b-1ebf-4256-9e14-7aaf8d1c6028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3d16b-1ebf-4256-9e14-7aaf8d1c6028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55605d60-bc39-468f-91c9-9bf43e8828b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55605d60-bc39-468f-91c9-9bf43e8828b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88a1c09-343b-4a6c-9752-01f310a52d8d', 'volume_name': 'volume-b88a1c09-343b-4a6c-9752-01f310a52d8d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b671115-81c3-450f-8cf7-b736b1e40f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b671115-81c3-450f-8cf7-b736b1e40f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b94925-e4e6-41a1-aa14-c40ca00018eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Volume b88a1c09-343b-4a6c-9752-01f310a52d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88a1c09-343b-4a6c-9752-01f310a52d8d', 'volume_size': 1} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:12 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.info" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417887806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338d60c2-5135-4dcd-a3af-99ffb55f279b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:12Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Creating volume 338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:12 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:12 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b 1073741824 Jul 20 16:59:12 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-250694af-4789-44cb-8de0-fabecb8f0b83 tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:59:12 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b 1073741824" returned: 0 in 0.409s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:12 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b Jul 20 16:59:12 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:12 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-149973840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88a1c09-343b-4a6c-9752-01f310a52d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:12Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Creating volume b88a1c09-343b-4a6c-9752-01f310a52d8d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:12 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b448994-27a1-4743-aee6-23d1016723f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338d60c2-5135-4dcd-a3af-99ffb55f279b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:12 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d 1073741824 Jul 20 16:59:12 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13858b11-233d-472a-96fa-cf49ae7ba7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:12 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Volume volume-338d60c2-5135-4dcd-a3af-99ffb55f279b (338d60c2-5135-4dcd-a3af-99ffb55f279b): created successfully Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13858b11-233d-472a-96fa-cf49ae7ba7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:12 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (2314bd05-8d96-4c8f-a39c-388d9cd69e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:12 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-a08c15b3-f3b1-4bfb-9f97-828800b5d37c tempest-ProjectReaderTests-916422338 None] Created volume successfully. Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-f8531be8-366f-47b5-9a34-1b20190ca705-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-f8531be8-366f-47b5-9a34-1b20190ca705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-ae6771db-60d5-48e8-b18b-0c81689669fa" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-ae6771db-60d5-48e8-b18b-0c81689669fa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-f8531be8-366f-47b5-9a34-1b20190ca705" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-f8531be8-366f-47b5-9a34-1b20190ca705" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot f8531be8-366f-47b5-9a34-1b20190ca705 of volume ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd4e3c9-537e-4962-9e24-d3c538e726e1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:13 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 Jul 20 16:59:13 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:13 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d 1073741824" returned: 0 in 0.466s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:13 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d Jul 20 16:59:13 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:13 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae6771db-60d5-48e8-b18b-0c81689669fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade5caec-d408-42c7-ab5b-b43f38b8bcd1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:13 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d" returned: 0 in 0.257s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b94925-e4e6-41a1-aa14-c40ca00018eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88a1c09-343b-4a6c-9752-01f310a52d8d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e435cd-b1b7-43ce-8402-42f12967ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:13 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Volume volume-b88a1c09-343b-4a6c-9752-01f310a52d8d (b88a1c09-343b-4a6c-9752-01f310a52d8d): created successfully Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e435cd-b1b7-43ce-8402-42f12967ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (1a0493e9-db48-41ac-8dc2-ef9d8177bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:13 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa Jul 20 16:59:13 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:13 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f693ec1a-fb40-4f00-b126-ed66e40429c6 tempest-ProjectReaderTests-1847092811 None] Created volume successfully. Jul 20 16:59:13 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa" returned: 0 in 0.381s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:13 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 Jul 20 16:59:13 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Creating offline snapshot 5924da08-9941-4889-b2df-04a8e921e4f6 of volume 338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf048b9b-6d22-40d2-b1a0-caf17ea1509d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:13 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:14 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b Jul 20 16:59:14 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-b88a1c09-343b-4a6c-9752-01f310a52d8d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Lock "cinder-b88a1c09-343b-4a6c-9752-01f310a52d8d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-quobyte-b88a1c09-343b-4a6c-9752-01f310a52d8d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-b88a1c09-343b-4a6c-9752-01f310a52d8d" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73bb769-5128-4459-bb82-6acb415b80fe]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:14 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705" returned: 0 in 0.379s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:14 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705 Jul 20 16:59:14 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:14 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d Jul 20 16:59:14 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:14 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b" returned: 0 in 0.424s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:14 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 1G Jul 20 16:59:14 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:14 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa.f8531be8-366f-47b5-9a34-1b20190ca705" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-f8531be8-366f-47b5-9a34-1b20190ca705" released by "_delete_snapshot" :: held 1.500s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-ae6771db-60d5-48e8-b18b-0c81689669fa" released by "delete_snapshot" :: held 1.523s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Created reservations ['9905b57e-9939-415f-9bf8-e0169a619b83', 'b05ac3d1-e15a-4048-baff-1a831187a565', '1f10c903-f649-4796-ba2c-99a5b9193f65', '3352acce-0749-4ccb-80a2-285317d8bf91'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:14 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d" returned: 0 in 0.425s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:14 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d Jul 20 16:59:14 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:14 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-4c6e4d73-cf51-47ea-8385-c45a34fbc7d9 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-f8531be8-366f-47b5-9a34-1b20190ca705-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:14 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 1G" returned: 0 in 0.454s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338d60c2-5135-4dcd-a3af-99ffb55f279b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:14 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338d60c2-5135-4dcd-a3af-99ffb55f279b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 Jul 20 16:59:14 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:14 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:14 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b88a1c09-343b-4a6c-9752-01f310a52d8d" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-b88a1c09-343b-4a6c-9752-01f310a52d8d" released by "delete_volume" :: held 0.750s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Created reservations ['18893731-451f-417d-ab16-481e63bc9461', '954f0a97-db14-441e-88b2-981111e26afd', 'ab22f3f8-f260-4ee5-a2c8-d3baca08c8b4', 'cea470ca-8556-4cb3-9289-9bd61c2dea97'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:15 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:15 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:15 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-ae6771db-60d5-48e8-b18b-0c81689669fa-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338d60c2-5135-4dcd-a3af-99ffb55f279b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6" returned: 0 in 0.357s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:15 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 is being set with open permissions: ugo+rw Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Lock "cinder-ae6771db-60d5-48e8-b18b-0c81689669fa-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:15 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 Jul 20 16:59:15 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-ae6771db-60d5-48e8-b18b-0c81689669fa" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-ae6771db-60d5-48e8-b18b-0c81689669fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec3f59f-7f86-4b9e-a8b4-46718339f58a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:15 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:15 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Deleted volume successfully. Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-23c64cee-bee9-44df-a15b-c22f7a86617f tempest-ProjectReaderTests-1847092811 None] Lock "cinder-b88a1c09-343b-4a6c-9752-01f310a52d8d-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:15 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa Jul 20 16:59:15 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:15 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6" returned: 0 in 0.345s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:15 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info Jul 20 16:59:15 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:15 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa" returned: 0 in 0.419s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:15 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa Jul 20 16:59:15 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (2a6f14b6-5612-476c-b23b-ea5bdc1e37cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c203df3b-0c64-4e04-a794-0500e8ed6d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:15 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:15 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info is being set with open permissions: ugo+rw Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c203df3b-0c64-4e04-a794-0500e8ed6d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379511796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586c71a9-66c8-4e27-af0b-216d8fd87206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:16Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:15 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info Jul 20 16:59:15 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fe9731-66ef-451b-9543-ed628839acc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fe9731-66ef-451b-9543-ed628839acc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e47a49-951a-45aa-bd85-2402db5a520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e47a49-951a-45aa-bd85-2402db5a520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '586c71a9-66c8-4e27-af0b-216d8fd87206', 'volume_name': 'volume-586c71a9-66c8-4e27-af0b-216d8fd87206', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00354e7c-7675-4b7b-b572-6abb6467ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00354e7c-7675-4b7b-b572-6abb6467ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa7aea4-bc65-4f87-a68a-53ef936a1829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:15 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Volume 586c71a9-66c8-4e27-af0b-216d8fd87206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-586c71a9-66c8-4e27-af0b-216d8fd87206', 'volume_size': 1} Jul 20 16:59:15 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:16 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-ae6771db-60d5-48e8-b18b-0c81689669fa" returned: 0 in 0.261s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-ae6771db-60d5-48e8-b18b-0c81689669fa" released by "delete_volume" :: held 0.745s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Created reservations ['0e5448bd-916c-4474-89fa-de579f82bb79', '4b1debe8-9d80-4a1d-99f3-a5368ba599ee', '4eadfe2d-f13c-444d-b70c-3b1066228df0', '1e309bce-01cd-432a-96af-49b2515547f1'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:16 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.info" returned: 0 in 0.291s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:16 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:16 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379511796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586c71a9-66c8-4e27-af0b-216d8fd87206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:16Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Creating volume 586c71a9-66c8-4e27-af0b-216d8fd87206 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:16 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:16 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 1073741824 Jul 20 16:59:16 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f78eaeb6-7551-4ec8-8f70-8a9ed688d8c6 tempest-ProjectReaderTests-916422338 None] Create snapshot completed successfully Jul 20 16:59:16 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.270s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:16 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-c80c992d-2ac4-4c92-8589-41d0298b65db tempest-ProjectMemberTests-1121326326 None] Lock "cinder-ae6771db-60d5-48e8-b18b-0c81689669fa-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:16 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 1073741824" returned: 0 in 0.488s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:16 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 Jul 20 16:59:16 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (d79246e5-ec94-4b1e-ae71-31c7c40608fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb8338d-8bc6-484d-b2a3-22fd596aa90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb8338d-8bc6-484d-b2a3-22fd596aa90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320774907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15018f2a-6d1e-416a-8ed6-aac277887b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:17Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03334c9b-5419-4f40-873a-5dc3f4e22669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03334c9b-5419-4f40-873a-5dc3f4e22669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1512eac5-8f8d-46f6-8e41-387fe6480d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1512eac5-8f8d-46f6-8e41-387fe6480d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15018f2a-6d1e-416a-8ed6-aac277887b05', 'volume_name': 'volume-15018f2a-6d1e-416a-8ed6-aac277887b05', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6089fbbb-29c0-451f-a9fd-3931abb21b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6089fbbb-29c0-451f-a9fd-3931abb21b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5f2c03-4c41-4c60-a5a4-48f07d919c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:16 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Volume 15018f2a-6d1e-416a-8ed6-aac277887b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15018f2a-6d1e-416a-8ed6-aac277887b05', 'volume_size': 1} Jul 20 16:59:16 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:17 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206" returned: 0 in 0.273s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-320774907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15018f2a-6d1e-416a-8ed6-aac277887b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:17Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Creating volume 15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:17 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa7aea4-bc65-4f87-a68a-53ef936a1829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586c71a9-66c8-4e27-af0b-216d8fd87206', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8face432-7c42-4da4-bdc1-5c09f61e3ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:17 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 1073741824 Jul 20 16:59:17 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:17 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Volume volume-586c71a9-66c8-4e27-af0b-216d8fd87206 (586c71a9-66c8-4e27-af0b-216d8fd87206): created successfully Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8face432-7c42-4da4-bdc1-5c09f61e3ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (2a6f14b6-5612-476c-b23b-ea5bdc1e37cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-e5799474-25c0-473c-8448-0e3ea9cf771e tempest-ProjectReaderTests-1847092811 None] Created volume successfully. Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-5924da08-9941-4889-b2df-04a8e921e4f6-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Lock "cinder-5924da08-9941-4889-b2df-04a8e921e4f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-338d60c2-5135-4dcd-a3af-99ffb55f279b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-338d60c2-5135-4dcd-a3af-99ffb55f279b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-5924da08-9941-4889-b2df-04a8e921e4f6" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-5924da08-9941-4889-b2df-04a8e921e4f6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Deleting offline snapshot 5924da08-9941-4889-b2df-04a8e921e4f6 of volume 338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] snapshot_file for this snap is: volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ca633-8b64-4932-bf8c-ea3519a8789d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:17 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 Jul 20 16:59:17 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:17 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 1073741824" returned: 0 in 0.430s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:17 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 Jul 20 16:59:17 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:17 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6" returned: 0 in 0.374s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-338d60c2-5135-4dcd-a3af-99ffb55f279b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6619953-478d-445c-9106-173bc2260499]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:17 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b Jul 20 16:59:17 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:17 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5f2c03-4c41-4c60-a5a4-48f07d919c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15018f2a-6d1e-416a-8ed6-aac277887b05', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926f376b-b2cc-48c1-b23a-9e0fec590192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:17 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Volume volume-15018f2a-6d1e-416a-8ed6-aac277887b05 (15018f2a-6d1e-416a-8ed6-aac277887b05): created successfully Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926f376b-b2cc-48c1-b23a-9e0fec590192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (d79246e5-ec94-4b1e-ae71-31c7c40608fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:17 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-04db4eff-f3d2-41c0-aed9-a64b7f69ad9b tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:59:17 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-586c71a9-66c8-4e27-af0b-216d8fd87206-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-586c71a9-66c8-4e27-af0b-216d8fd87206-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:18 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b" returned: 0 in 0.408s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:18 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 Jul 20 16:59:18 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-quobyte-586c71a9-66c8-4e27-af0b-216d8fd87206" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-586c71a9-66c8-4e27-af0b-216d8fd87206" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781b1dc-0596-4439-ad8f-10a5945a9793]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:18 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 Jul 20 16:59:18 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:18 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:18 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6 Jul 20 16:59:18 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:18 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206" returned: 0 in 0.383s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:18 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206 Jul 20 16:59:18 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:18 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b.5924da08-9941-4889-b2df-04a8e921e4f6" returned: 0 in 0.254s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-5924da08-9941-4889-b2df-04a8e921e4f6" released by "_delete_snapshot" :: held 1.462s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-338d60c2-5135-4dcd-a3af-99ffb55f279b" released by "delete_snapshot" :: held 1.482s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Created reservations ['ea587d0b-85b3-4175-8dab-bd7d56033bf2', 'f871d047-21db-4151-8772-c285a4bbb33b', '5a321c43-806e-4752-8d5b-452c6e9235a1', 'b87cdcf7-9f98-4685-ab54-ac342ccd453d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:18 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:18 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Delete snapshot completed successfully. Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-586c71a9-66c8-4e27-af0b-216d8fd87206" returned: 0 in 0.272s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-8733b534-b2e6-401f-bec0-e7e0f3778f2e tempest-ProjectReaderTests-916422338 None] Lock "cinder-5924da08-9941-4889-b2df-04a8e921e4f6-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-586c71a9-66c8-4e27-af0b-216d8fd87206" released by "delete_volume" :: held 0.697s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Created reservations ['56a7a34a-ee01-4a70-b28f-a7c7e0fb243d', 'e4e5fb77-6ba4-4e3e-b559-89a7ed389d6e', '1df4c995-1bcf-4209-9e74-c5fe9359baff', '599477f4-408d-4421-a56c-d740eba118bf'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:18 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:18 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:18 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e of volume 15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:19 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.273s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:19 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Deleted volume successfully. Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe1897-c1aa-4064-b9ae-686d6dd7f66a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-ba65f5a0-0bfa-468e-b78a-cbbb627bcf67 tempest-ProjectReaderTests-1847092811 None] Lock "cinder-586c71a9-66c8-4e27-af0b-216d8fd87206-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:19 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 Jul 20 16:59:19 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-338d60c2-5135-4dcd-a3af-99ffb55f279b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Lock "cinder-338d60c2-5135-4dcd-a3af-99ffb55f279b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-338d60c2-5135-4dcd-a3af-99ffb55f279b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-338d60c2-5135-4dcd-a3af-99ffb55f279b" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[d883f779-eb5b-4337-a49a-29afb8d965e3]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:19 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b Jul 20 16:59:19 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:19 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05" returned: 0 in 0.546s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:19 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e 1G Jul 20 16:59:19 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (7d7ab1e5-7fd2-44dc-8137-838b469ad6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f451952d-8af9-475b-a97b-fb4a234bc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f451952d-8af9-475b-a97b-fb4a234bc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005045473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4996593-97d4-4bf1-a951-f1fca382657e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:20Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b14e73-a329-463c-8e5d-44213c4c5457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b14e73-a329-463c-8e5d-44213c4c5457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92a402c-8413-469c-9f56-9730a5fb3df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92a402c-8413-469c-9f56-9730a5fb3df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4996593-97d4-4bf1-a951-f1fca382657e', 'volume_name': 'volume-e4996593-97d4-4bf1-a951-f1fca382657e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fc988f-c7fa-4b1d-b20b-db391810f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fc988f-c7fa-4b1d-b20b-db391810f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd865bbe-1c36-4ccb-8703-28fecb38f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:19 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Volume e4996593-97d4-4bf1-a951-f1fca382657e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4996593-97d4-4bf1-a951-f1fca382657e', 'volume_size': 1} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:19 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b" returned: 0 in 0.411s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:19 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:20 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b Jul 20 16:59:20 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:20 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e 1G" returned: 0 in 0.451s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15018f2a-6d1e-416a-8ed6-aac277887b05 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:20 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15018f2a-6d1e-416a-8ed6-aac277887b05 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e Jul 20 16:59:20 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:20 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-338d60c2-5135-4dcd-a3af-99ffb55f279b" returned: 0 in 0.260s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-338d60c2-5135-4dcd-a3af-99ffb55f279b" released by "delete_volume" :: held 0.744s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Created reservations ['b71ed32e-cc45-480d-bbe6-f28ca881137e', '0b3c8951-1433-4c67-930f-64b7d2239a75', 'a100440f-cc49-49e5-9263-e1a8b33e1795', '457c936f-4328-4e24-8067-7d78b2769af0'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:20 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:20 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:20 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15018f2a-6d1e-416a-8ed6-aac277887b05 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" returned: 0 in 0.305s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:20 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e is being set with open permissions: ugo+rw Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:20 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e Jul 20 16:59:20 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:20 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:20 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Deleted volume successfully. Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-b1c96a03-9aa1-4102-8313-27e406a027c2 tempest-ProjectReaderTests-916422338 None] Lock "cinder-338d60c2-5135-4dcd-a3af-99ffb55f279b-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:20 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" returned: 0 in 0.294s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:20 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:20 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info Jul 20 16:59:20 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:21 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:21 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info is being set with open permissions: ugo+rw Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:21 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info Jul 20 16:59:21 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (7ca9db41-4726-4a2c-bbaa-902d1dfe5561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83930a83-bf0b-471c-854a-7e55dba707d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83930a83-bf0b-471c-854a-7e55dba707d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802160361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e2e330-1b22-4cb4-9e88-8cc6c7c9357d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:21Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b88db6-b235-4f70-8159-7de71a5dd52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b88db6-b235-4f70-8159-7de71a5dd52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e33f6c-3413-425f-ad5a-91fa5a17f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e33f6c-3413-425f-ad5a-91fa5a17f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e2e330-1b22-4cb4-9e88-8cc6c7c9357d', 'volume_name': 'volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd472874-f9b9-4cdc-a6d5-63723e4087e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd472874-f9b9-4cdc-a6d5-63723e4087e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fde4a4-5ce0-4b73-b279-ca787b0b47b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Volume 81e2e330-1b22-4cb4-9e88-8cc6c7c9357d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d', 'volume_size': 1} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:21 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.info" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005045473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4996593-97d4-4bf1-a951-f1fca382657e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5a95ec8dd44948ba595fa1b8808ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:20Z,use_quota=True,user_id='1ae59fb9e8924c90b0b216e2b52239dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Creating volume e4996593-97d4-4bf1-a951-f1fca382657e {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:21 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:21 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e 1073741824 Jul 20 16:59:21 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:21 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-49f5d124-ec8d-45f4-b1dc-81aadd5a26bb tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:59:21 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e 1073741824" returned: 0 in 0.420s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:21 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e Jul 20 16:59:21 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:22 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802160361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e2e330-1b22-4cb4-9e88-8cc6c7c9357d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:21Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Creating volume 81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:22 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd865bbe-1c36-4ccb-8703-28fecb38f36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4996593-97d4-4bf1-a951-f1fca382657e', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:22 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d 1073741824 Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d00263d-9749-4ffa-a41b-d498bafe67b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:22 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Volume volume-e4996593-97d4-4bf1-a951-f1fca382657e (e4996593-97d4-4bf1-a951-f1fca382657e): created successfully Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d00263d-9749-4ffa-a41b-d498bafe67b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Flow 'volume_create_manager' (7d7ab1e5-7fd2-44dc-8137-838b469ad6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1a0de07e-7d1e-4074-80bc-c9a945dce837 tempest-ProjectReaderTests-1847092811 None] Created volume successfully. Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-15018f2a-6d1e-416a-8ed6-aac277887b05" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-15018f2a-6d1e-416a-8ed6-aac277887b05" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e of volume 15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[216776d5-09ab-4157-bb6a-9b85cf89048d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:22 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e Jul 20 16:59:22 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:22 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d 1073741824" returned: 0 in 0.447s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:22 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d Jul 20 16:59:22 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:22 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" returned: 0 in 0.382s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15018f2a-6d1e-416a-8ed6-aac277887b05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05867c5-59b4-4b4d-8665-af332a9a4fe9]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:22 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fde4a4-5ce0-4b73-b279-ca787b0b47b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9515a592-34d7-4fc2-9f5b-b55605a76bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Volume volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d (81e2e330-1b22-4cb4-9e88-8cc6c7c9357d): created successfully Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9515a592-34d7-4fc2-9f5b-b55605a76bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (7ca9db41-4726-4a2c-bbaa-902d1dfe5561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9587a148-ef74-4895-a923-db0bf990fa8b tempest-ProjectReaderTests-916422338 None] Created volume successfully. Jul 20 16:59:22 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 Jul 20 16:59:22 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-e4996593-97d4-4bf1-a951-f1fca382657e-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Lock "cinder-e4996593-97d4-4bf1-a951-f1fca382657e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:22 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Acquiring lock "cinder-quobyte-e4996593-97d4-4bf1-a951-f1fca382657e" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-e4996593-97d4-4bf1-a951-f1fca382657e" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0bdf34-2bfd-46b1-9e0b-8fd82aebfd1d]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e Jul 20 16:59:23 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05" returned: 0 in 0.429s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e Jul 20 16:59:23 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Creating offline snapshot a009e54e-ab0c-4d86-a4f0-f28baf46a8dc of volume 81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c40d8a-f485-4e28-95ad-04febb525d13]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e" returned: 0 in 0.415s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e Jul 20 16:59:23 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d Jul 20 16:59:23 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" returned: 0 in 0.367s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e Jul 20 16:59:23 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-e4996593-97d4-4bf1-a951-f1fca382657e" returned: 0 in 0.262s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Lock "cinder-quobyte-e4996593-97d4-4bf1-a951-f1fca382657e" released by "delete_volume" :: held 0.719s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Created reservations ['e665d0d8-4981-4a4f-a4a6-a089bee4c7e9', '1a66ae96-cd4d-49da-a560-92c8ceea1d4b', '22ee0e39-6a39-4494-b695-a65d5b539c0f', '917ab681-c2e9-4119-a01c-a226b64d73d7'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:23 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" returned: 0 in 0.404s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc 1G Jul 20 16:59:23 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05.b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e" released by "_delete_snapshot" :: held 1.567s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-15018f2a-6d1e-416a-8ed6-aac277887b05" released by "delete_snapshot" :: held 1.594s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:23 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:23 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:23 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Created reservations ['d97d77ee-0207-40e6-bb35-3b5df6c0459d', '07f89f99-a4fd-465b-958e-a20d3fec453f', 'd6e2bcf9-e567-47f6-9480-f0546077cb36', 'c5344c12-7151-46b2-a1c4-33fb04ed6802'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-1f5319c3-23ad-451a-9539-bd025483e772 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-b871d27e-9abf-4c4c-8a6c-1fd6ed26ea2e-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:24 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.267s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Deleted volume successfully. Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-39867752-3fdb-4558-8ebb-975b76f0c59a tempest-ProjectReaderTests-1847092811 None] Lock "cinder-e4996593-97d4-4bf1-a951-f1fca382657e-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:24 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc 1G" returned: 0 in 0.477s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:24 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc Jul 20 16:59:24 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-15018f2a-6d1e-416a-8ed6-aac277887b05-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-15018f2a-6d1e-416a-8ed6-aac277887b05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-15018f2a-6d1e-416a-8ed6-aac277887b05" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-15018f2a-6d1e-416a-8ed6-aac277887b05" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35248bb-1bd3-45f5-8b81-0a1a5243aa57]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:24 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" returned: 0 in 0.364s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:24 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc is being set with open permissions: ugo+rw Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:24 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc Jul 20 16:59:24 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:24 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 Jul 20 16:59:24 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:24 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" returned: 0 in 0.286s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:24 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info Jul 20 16:59:24 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:25 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05" returned: 0 in 0.400s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:25 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05 Jul 20 16:59:25 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:25 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info" returned: 0 in 0.301s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:25 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info is being set with open permissions: ugo+rw Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:25 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-15018f2a-6d1e-416a-8ed6-aac277887b05" returned: 0 in 0.266s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:25 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info Jul 20 16:59:25 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-15018f2a-6d1e-416a-8ed6-aac277887b05" released by "delete_volume" :: held 0.739s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Created reservations ['5ef030ef-b076-443e-aa8c-0713421336aa', '04df0930-f14e-437a-87a8-642ba9872ba6', 'f752b27f-5284-4ee1-a251-5cd581a72992', 'b00391bb-26eb-40b2-9845-577b28b9068c'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:25 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:25 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:25 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.info" returned: 0 in 0.292s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-766209f4-86a5-4b5b-ade1-dfe00ef4c305 tempest-ProjectReaderTests-916422338 None] Create snapshot completed successfully Jul 20 16:59:25 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:25 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:59:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-0a6dd004-ba8d-4e4d-a548-8b97e5b70085 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-15018f2a-6d1e-416a-8ed6-aac277887b05-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (59b5e58c-9d7c-4ef7-89d9-d6383f74ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d386cd3-fcfb-4f60-80aa-6356311db462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d386cd3-fcfb-4f60-80aa-6356311db462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115674736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fb477a-6a74-45bc-a4c3-34dd81ef141b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:26Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839b6f52-e8de-48e3-8cb4-35d433e4f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839b6f52-e8de-48e3-8cb4-35d433e4f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99375a78-4971-4976-b36c-96c6ebadac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99375a78-4971-4976-b36c-96c6ebadac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fb477a-6a74-45bc-a4c3-34dd81ef141b', 'volume_name': 'volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7f0e8f-842d-4ba3-8b14-e84349eeed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7f0e8f-842d-4ba3-8b14-e84349eeed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab505d4-7d9f-4b79-8210-570ea1024136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:26 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Volume 89fb477a-6a74-45bc-a4c3-34dd81ef141b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b', 'volume_size': 1} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115674736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fb477a-6a74-45bc-a4c3-34dd81ef141b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:26Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Creating volume 89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:26 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:26 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b 1073741824 Jul 20 16:59:26 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-a009e54e-ab0c-4d86-a4f0-f28baf46a8dc-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Lock "cinder-a009e54e-ab0c-4d86-a4f0-f28baf46a8dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Deleting offline snapshot a009e54e-ab0c-4d86-a4f0-f28baf46a8dc of volume 81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] snapshot_file for this snap is: volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30cd739-1a40-49b5-9959-1fee48014ff6]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:26 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc Jul 20 16:59:26 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:26 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b 1073741824" returned: 0 in 0.454s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:26 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b Jul 20 16:59:26 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:26 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" returned: 0 in 0.371s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca241967-2a40-4747-b513-b46f3f2f9f88]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:27 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b" returned: 0 in 0.278s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab505d4-7d9f-4b79-8210-570ea1024136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b274d2-20fd-4fa7-9aa6-103a2fc0e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:27 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Volume volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b (89fb477a-6a74-45bc-a4c3-34dd81ef141b): created successfully Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b274d2-20fd-4fa7-9aa6-103a2fc0e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (59b5e58c-9d7c-4ef7-89d9-d6383f74ca80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:27 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-602575aa-9904-45cc-9f15-0aed26e92ac2 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:59:27 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d Jul 20 16:59:27 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot 5afd9d04-2677-4d9a-a8b4-529e282e9412 of volume 89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:27 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" returned: 0 in 0.388s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[b106ca94-345a-4100-b300-372b5b61dcbe]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:27 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc Jul 20 16:59:27 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:27 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b Jul 20 16:59:27 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:27 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" returned: 0 in 0.337s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:27 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc Jul 20 16:59:27 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:27 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b" returned: 0 in 0.370s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:27 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 1G Jul 20 16:59:27 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:27 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d.a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-a009e54e-ab0c-4d86-a4f0-f28baf46a8dc" released by "_delete_snapshot" :: held 1.438s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:27 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" released by "delete_snapshot" :: held 1.460s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Created reservations ['83d8d146-b9ed-4b2f-bd95-913f3b24c428', 'fb6fafba-4cb7-4cc7-a521-d138344714b6', 'eab25538-0f14-4e76-bb6f-f4fbefaf30fe', '4c0a7114-5aa3-4f98-b6ec-1d3a51b4422d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:28 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Delete snapshot completed successfully. Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-02a48c63-c065-412f-ba76-85d25ca205af tempest-ProjectReaderTests-916422338 None] Lock "cinder-a009e54e-ab0c-4d86-a4f0-f28baf46a8dc-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:28 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 1G" returned: 0 in 0.403s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:28 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 Jul 20 16:59:28 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:28 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412" returned: 0 in 0.279s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:28 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 is being set with open permissions: ugo+rw Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:28 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 Jul 20 16:59:28 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Lock "cinder-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:28 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:28 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info Jul 20 16:59:28 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" acquired by "delete_volume" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f1efa1-edd4-47e1-9d9f-af68c09a88f2]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:28 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d Jul 20 16:59:28 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:28 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:28 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info" returned: 0 in 0.261s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:28 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info is being set with open permissions: ugo+rw Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:29 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info Jul 20 16:59:29 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:29 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" returned: 0 in 0.362s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:29 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d Jul 20 16:59:29 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:29 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.info" returned: 0 in 0.248s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-ee07c0ba-dc52-46e2-9bf9-df2d54781f4f tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:59:29 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" returned: 0 in 0.256s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d" released by "delete_volume" :: held 0.679s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-5afd9d04-2677-4d9a-a8b4-529e282e9412-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-5afd9d04-2677-4d9a-a8b4-529e282e9412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-89fb477a-6a74-45bc-a4c3-34dd81ef141b" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-89fb477a-6a74-45bc-a4c3-34dd81ef141b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-5afd9d04-2677-4d9a-a8b4-529e282e9412" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-5afd9d04-2677-4d9a-a8b4-529e282e9412" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot 5afd9d04-2677-4d9a-a8b4-529e282e9412 of volume 89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Created reservations ['18d83504-2f58-448b-b464-79826f57bd0f', '202e5a23-b765-4c11-9467-d6ca38d79f52', 'df2939e3-3613-422d-9fd8-0ccf9c9183ab', '4ea3bdd8-65cd-4de9-8324-d676966cdb5a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[10832d67-f2d9-4150-8b5c-7669215e4502]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:29 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:29 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:29 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 Jul 20 16:59:29 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:29 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.274s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:29 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Deleted volume successfully. Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-48ec8bc0-ec75-499f-8a32-cbaed166fd50 tempest-ProjectReaderTests-916422338 None] Lock "cinder-81e2e330-1b22-4cb4-9e88-8cc6c7c9357d-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:29 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412" returned: 0 in 0.397s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea67a4a-b43c-45d4-8fd2-e2bca1f9b1ab]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:29 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:30 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b Jul 20 16:59:30 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (3e9acb77-f59f-4dda-b2b4-1298dfb7f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cf11b3-cbcb-4817-931d-1689fe9b5402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cf11b3-cbcb-4817-931d-1689fe9b5402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497735342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07ab936-dfd6-4b37-9af8-1679ec30c78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:30Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d39d1c-6af7-46f4-a0a0-f072b40ee538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d39d1c-6af7-46f4-a0a0-f072b40ee538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194c9e72-11cd-4ff7-84ea-ac81d9c43a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194c9e72-11cd-4ff7-84ea-ac81d9c43a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07ab936-dfd6-4b37-9af8-1679ec30c78f', 'volume_name': 'volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b335cef8-4ac9-4edc-9fc8-ea52b05b2585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b335cef8-4ac9-4edc-9fc8-ea52b05b2585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa054e5-a9e2-4de6-95da-e0a817b9e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:30 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:30 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Volume d07ab936-dfd6-4b37-9af8-1679ec30c78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f', 'volume_size': 1} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497735342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07ab936-dfd6-4b37-9af8-1679ec30c78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d919114a244f4ae668860b3615b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:30Z,use_quota=True,user_id='0ab6b53e06f64d36a526ab5b10f3b27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Creating volume d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:30 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b" returned: 0 in 0.389s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:30 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f 1073741824 Jul 20 16:59:30 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:30 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 Jul 20 16:59:30 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:30 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412" returned: 0 in 0.333s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:30 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412 Jul 20 16:59:30 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:30 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f 1073741824" returned: 0 in 0.434s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:30 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f Jul 20 16:59:30 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:30 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b.5afd9d04-2677-4d9a-a8b4-529e282e9412" returned: 0 in 0.258s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-5afd9d04-2677-4d9a-a8b4-529e282e9412" released by "_delete_snapshot" :: held 1.474s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-89fb477a-6a74-45bc-a4c3-34dd81ef141b" released by "delete_snapshot" :: held 1.505s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Created reservations ['aa9695ba-886e-4fe5-bc57-17a88319fc4a', '4963d488-5c6e-4a2d-99ed-34057ebdaa38', '58b23e43-abff-46a1-a71c-d5317e8e8ca9', '7a892e41-8c3d-4e8b-b68b-aa41b925ded5'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:31 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f" returned: 0 in 0.266s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa054e5-a9e2-4de6-95da-e0a817b9e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae265f6-a9d9-48a6-af9e-3c115fc660fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-acfc1fc5-6f0b-41b6-a1c9-ae61075c8bf6 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-5afd9d04-2677-4d9a-a8b4-529e282e9412-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:31 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Volume volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f (d07ab936-dfd6-4b37-9af8-1679ec30c78f): created successfully Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae265f6-a9d9-48a6-af9e-3c115fc660fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Flow 'volume_create_manager' (3e9acb77-f59f-4dda-b2b4-1298dfb7f573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cbfeb4aa-0311-44ab-961b-007dd3df2786 tempest-ProjectReaderTests-916422338 None] Created volume successfully. Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Creating offline snapshot 9dfcc119-4b91-410f-b4cd-3494e0b4d676 of volume d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef1361-1550-4d95-9e82-382aeb71575a]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:31 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f Jul 20 16:59:31 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-89fb477a-6a74-45bc-a4c3-34dd81ef141b-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-89fb477a-6a74-45bc-a4c3-34dd81ef141b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-89fb477a-6a74-45bc-a4c3-34dd81ef141b" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-89fb477a-6a74-45bc-a4c3-34dd81ef141b" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb769df0-9b72-4604-8ee8-7d2b007278f3]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:31 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f" returned: 0 in 0.368s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:31 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 1G Jul 20 16:59:31 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:31 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b Jul 20 16:59:31 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:32 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b" returned: 0 in 0.380s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:32 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b Jul 20 16:59:32 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:32 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 1G" returned: 0 in 0.383s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:32 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 Jul 20 16:59:32 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:32 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-89fb477a-6a74-45bc-a4c3-34dd81ef141b" returned: 0 in 0.259s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-89fb477a-6a74-45bc-a4c3-34dd81ef141b" released by "delete_volume" :: held 0.697s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Created reservations ['03449b7f-bdc8-4f2f-a05c-6f53b1389e88', '1d29a5ba-56f0-4907-b1ab-5c8aef682259', '7c31e52f-df4c-4d3f-aa39-ee5498fed6bc', '890115bf-412a-468f-8fc7-95e598166240'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:32 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:32 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 is being set with open permissions: ugo+rw Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:32 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 Jul 20 16:59:32 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:32 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:32 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:32 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676" returned: 0 in 0.263s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:32 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info Jul 20 16:59:32 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:32 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:32 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:59:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-9ae50d77-deff-488c-9d5a-d969c2b6a554 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-89fb477a-6a74-45bc-a4c3-34dd81ef141b-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:33 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info" returned: 0 in 0.275s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:33 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info is being set with open permissions: ugo+rw Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:33 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info Jul 20 16:59:33 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (ad68637c-3f10-4f04-952e-15375f869f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac339e2-5ee5-46df-8074-26c81db46b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac339e2-5ee5-46df-8074-26c81db46b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218392736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48401bc4-a14a-4720-86de-6c3a0dfeffb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:33Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:33 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed72c075-a97c-44ce-80c6-75de5220985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed72c075-a97c-44ce-80c6-75de5220985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce06edc-1a82-44fb-9b2e-b6eabd31f235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce06edc-1a82-44fb-9b2e-b6eabd31f235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48401bc4-a14a-4720-86de-6c3a0dfeffb2', 'volume_name': 'volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b6b96c-8b81-483d-a648-1021a211fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b6b96c-8b81-483d-a648-1021a211fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1149572-6b28-4458-88bc-97b2f5a6e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:33 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Volume 48401bc4-a14a-4720-86de-6c3a0dfeffb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2', 'volume_size': 1} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.info" returned: 0 in 0.281s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218392736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48401bc4-a14a-4720-86de-6c3a0dfeffb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:33Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Creating volume 48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:33 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:33 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 1073741824 Jul 20 16:59:33 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-312d070c-41e8-4bfa-9153-3285d40ed760 tempest-ProjectReaderTests-916422338 None] Create snapshot completed successfully Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-9dfcc119-4b91-410f-b4cd-3494e0b4d676-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Lock "cinder-9dfcc119-4b91-410f-b4cd-3494e0b4d676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-d07ab936-dfd6-4b37-9af8-1679ec30c78f" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d07ab936-dfd6-4b37-9af8-1679ec30c78f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-9dfcc119-4b91-410f-b4cd-3494e0b4d676" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-9dfcc119-4b91-410f-b4cd-3494e0b4d676" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Deleting offline snapshot 9dfcc119-4b91-410f-b4cd-3494e0b4d676 of volume d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] snapshot_file for this snap is: volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[91340945-ade2-4aa6-90c2-0206bda8dfc1]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:33 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 Jul 20 16:59:33 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:33 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 1073741824" returned: 0 in 0.442s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:33 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 Jul 20 16:59:33 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:34 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676" returned: 0 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7879c2-4678-4c88-a9fe-48c0a2f2ced8]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:34 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2" returned: 0 in 0.253s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1149572-6b28-4458-88bc-97b2f5a6e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d0e35a-da4e-42a0-a394-7819bfe0c7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:34 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Volume volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 (48401bc4-a14a-4720-86de-6c3a0dfeffb2): created successfully Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d0e35a-da4e-42a0-a394-7819bfe0c7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:34 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (ad68637c-3f10-4f04-952e-15375f869f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:34 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:34 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cd0aaf79-f30d-4f5c-a335-ef8bb433096f tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:59:34 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f" returned: 0 in 0.380s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:34 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 Jul 20 16:59:34 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot 34b6ab37-e4d2-40bc-8719-3783836a8fee of volume 48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e55b484-53f8-4b36-8262-373b9d7b3ddc]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:34 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 Jul 20 16:59:34 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:34 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676" returned: 0 in 0.332s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:34 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676 Jul 20 16:59:34 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:34 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2" returned: 0 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:34 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee 1G Jul 20 16:59:34 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:35 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f.9dfcc119-4b91-410f-b4cd-3494e0b4d676" returned: 0 in 0.265s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-9dfcc119-4b91-410f-b4cd-3494e0b4d676" released by "_delete_snapshot" :: held 1.437s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d07ab936-dfd6-4b37-9af8-1679ec30c78f" released by "delete_snapshot" :: held 1.463s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Created reservations ['49c22e50-d470-45e1-bbcb-62b0f2f98137', 'af0d2731-9230-4193-a473-896698ecd5e8', '12d1bd51-3fb7-48fc-9b1b-a0638c29d105', '65ebb7d5-74f7-40ca-bf17-7ad23ea5f431'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Delete snapshot completed successfully. Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-98237dfc-4872-4cd2-84ab-7b63f5bf8835 tempest-ProjectReaderTests-916422338 None] Lock "cinder-9dfcc119-4b91-410f-b4cd-3494e0b4d676-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:35 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee 1G" returned: 0 in 0.426s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:35 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee Jul 20 16:59:35 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:35 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee" returned: 0 in 0.277s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:35 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee is being set with open permissions: ugo+rw Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:35 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee Jul 20 16:59:35 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-d07ab936-dfd6-4b37-9af8-1679ec30c78f-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Lock "cinder-d07ab936-dfd6-4b37-9af8-1679ec30c78f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Acquiring lock "cinder-quobyte-d07ab936-dfd6-4b37-9af8-1679ec30c78f" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d07ab936-dfd6-4b37-9af8-1679ec30c78f" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:35 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee" returned: 0 in 0.271s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b54a056-c1b1-484b-a985-a5ec79b7fd39]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:35 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info Jul 20 16:59:35 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:35 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f Jul 20 16:59:35 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:36 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info" returned: 0 in 0.250s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:36 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info is being set with open permissions: ugo+rw Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:36 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info Jul 20 16:59:36 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:36 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f" returned: 0 in 0.360s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:36 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f Jul 20 16:59:36 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:36 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.info" returned: 0 in 0.247s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-8a6c5043-0699-4a8c-99be-e899b74a6ddb tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:59:36 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-d07ab936-dfd6-4b37-9af8-1679ec30c78f" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Lock "cinder-quobyte-d07ab936-dfd6-4b37-9af8-1679ec30c78f" released by "delete_volume" :: held 0.671s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Created reservations ['0573248b-f92b-49cd-93aa-e17cb182c38f', '3096e59e-35dc-48c6-8013-520ac29bbf64', 'd4ea2703-c4ee-4bc0-9f02-19317b1bce3b', '64bbeee3-2b5d-4668-bdba-56c560109299'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-34b6ab37-e4d2-40bc-8719-3783836a8fee-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-34b6ab37-e4d2-40bc-8719-3783836a8fee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-48401bc4-a14a-4720-86de-6c3a0dfeffb2" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:36 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:36 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-48401bc4-a14a-4720-86de-6c3a0dfeffb2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-34b6ab37-e4d2-40bc-8719-3783836a8fee" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-34b6ab37-e4d2-40bc-8719-3783836a8fee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot 34b6ab37-e4d2-40bc-8719-3783836a8fee of volume 48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a45c972-4f76-4531-8836-b74a14b925ae]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:36 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee Jul 20 16:59:36 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:36 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Deleted volume successfully. Jul 20 16:59:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-d1f29005-cbd7-4f84-932b-431d7a8f5c51 tempest-ProjectReaderTests-916422338 None] Lock "cinder-d07ab936-dfd6-4b37-9af8-1679ec30c78f-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:37 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee" returned: 0 in 0.385s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[0756ac7c-d96e-4f0b-8f42-58ef6cad02cc]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:37 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 Jul 20 16:59:37 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:37 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2" returned: 0 in 0.370s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:37 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee Jul 20 16:59:37 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:37 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee" returned: 0 in 0.396s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:37 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:37 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee Jul 20 16:59:37 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:38 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2.34b6ab37-e4d2-40bc-8719-3783836a8fee" returned: 0 in 0.249s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-34b6ab37-e4d2-40bc-8719-3783836a8fee" released by "_delete_snapshot" :: held 1.495s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-48401bc4-a14a-4720-86de-6c3a0dfeffb2" released by "delete_snapshot" :: held 1.520s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Created reservations ['1d823718-80dd-4452-adad-293689bebd67', '274d77c7-8ee5-4038-8aa7-06245fc77ab9', 'cb4a54a2-e91d-45f7-ac43-53e4ca856abc', '4008673a-acd3-4170-9231-819311bd501a'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:38 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-bc389936-44e8-417f-a28c-9cd01b055740 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-34b6ab37-e4d2-40bc-8719-3783836a8fee-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-48401bc4-a14a-4720-86de-6c3a0dfeffb2-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Lock "cinder-48401bc4-a14a-4720-86de-6c3a0dfeffb2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-48401bc4-a14a-4720-86de-6c3a0dfeffb2" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-48401bc4-a14a-4720-86de-6c3a0dfeffb2" acquired by "delete_volume" :: waited 0.018s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[53913ad6-1e72-40ff-9dbe-d29deedb8dbd]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:38 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:38 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 Jul 20 16:59:38 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:39 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:39 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:39 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2" returned: 0 in 0.401s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:39 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2 Jul 20 16:59:39 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:39 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 16:59:39 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-48401bc4-a14a-4720-86de-6c3a0dfeffb2" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-48401bc4-a14a-4720-86de-6c3a0dfeffb2" released by "delete_volume" :: held 0.729s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Created reservations ['e93e87d7-c534-4f41-998a-3b428920041f', 'b654c33a-d629-4ebd-a13f-b6f6dde7d759', '6e9c944d-cb15-47e6-a2dc-a52fe322ec6b', 'ea74da37-dcb4-4637-a13b-805b12fb1a14'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:39 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:39 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:39 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.274s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:39 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:59:39 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-88a72bee-53bd-4f7e-ab1a-4cd261c47c6d tempest-ProjectMemberTests-1121326326 None] Lock "cinder-48401bc4-a14a-4720-86de-6c3a0dfeffb2-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (d5fd2401-96d0-4bf4-a3f7-f1ccdc73b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31467c21-1456-4886-acaf-c53cd1154b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31467c21-1456-4886-acaf-c53cd1154b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214733768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1412f0be-cae4-42fa-b76d-be5b4e1c69b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:40Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1be057c-c417-4b02-91a9-1c7631840582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1be057c-c417-4b02-91a9-1c7631840582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd85212b-e41c-401b-93ab-dfff0e6ade83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd85212b-e41c-401b-93ab-dfff0e6ade83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1412f0be-cae4-42fa-b76d-be5b4e1c69b0', 'volume_name': 'volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4f2d31-5086-4744-b727-26badcaee0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4f2d31-5086-4744-b727-26badcaee0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b0c4cf-44b9-477d-bffe-3a2703e21051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:40 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Volume 1412f0be-cae4-42fa-b76d-be5b4e1c69b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0', 'volume_size': 1} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T14:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214733768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1412f0be-cae4-42fa-b76d-be5b4e1c69b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da98620e6fca4459ab45a4ded1e4dfce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T14:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T14:59:40Z,use_quota=True,user_id='f2ecdbac548b4d46af4329970489e317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Creating volume 1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 16:59:40 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:40 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 1073741824 Jul 20 16:59:40 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:40 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 1073741824" returned: 0 in 0.436s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:40 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:40 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 Jul 20 16:59:40 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:41 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" returned: 0 in 0.241s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b0c4cf-44b9-477d-bffe-3a2703e21051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c93f3a7-063e-456c-bac5-6a131626dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 16:59:41 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Volume volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 (1412f0be-cae4-42fa-b76d-be5b4e1c69b0): created successfully Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c93f3a7-063e-456c-bac5-6a131626dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Flow 'volume_create_manager' (d5fd2401-96d0-4bf4-a3f7-f1ccdc73b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 16:59:41 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-25f1505d-3d88-4982-b8de-bfeb5f1c64c5 tempest-ProjectMemberTests-1121326326 None] Created volume successfully. Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Creating offline snapshot a64ebd72-8861-4378-afe2-681aa910b7bb of volume 1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3d256-28a0-4e82-a08d-e36591182a6c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:41 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 Jul 20 16:59:41 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:41 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" returned: 0 in 0.373s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:41 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:41 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb 1G Jul 20 16:59:41 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:42 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb 1G" returned: 0 in 0.407s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:42 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb Jul 20 16:59:42 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:42 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb" returned: 0 in 0.298s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:42 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb is being set with open permissions: ugo+rw Jul 20 16:59:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:42 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb Jul 20 16:59:42 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:42 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb" returned: 0 in 0.246s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:42 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:42 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info Jul 20 16:59:42 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:43 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info" returned: 0 in 0.238s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:43 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info is being set with open permissions: ugo+rw Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:43 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info Jul 20 16:59:43 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:43 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.info" returned: 0 in 0.252s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:43 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f9c12f99-d6be-477f-8791-f139788ca851 tempest-ProjectMemberTests-1121326326 None] Create snapshot completed successfully Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-a64ebd72-8861-4378-afe2-681aa910b7bb-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-a64ebd72-8861-4378-afe2-681aa910b7bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-a64ebd72-8861-4378-afe2-681aa910b7bb" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-a64ebd72-8861-4378-afe2-681aa910b7bb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Deleting offline snapshot a64ebd72-8861-4378-afe2-681aa910b7bb of volume 1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] snapshot_file for this snap is: volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2432a2-8566-403c-abcb-27e58097431c]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:43 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:43 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb Jul 20 16:59:43 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:44 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb" returned: 0 in 0.378s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[04246c87-6495-486e-8591-65b0bac2be8b]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:44 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 Jul 20 16:59:44 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:44 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" returned: 0 in 0.355s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:44 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb Jul 20 16:59:44 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:44 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb" returned: 0 in 0.330s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:44 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:44 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb Jul 20 16:59:44 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:45 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0.a64ebd72-8861-4378-afe2-681aa910b7bb" returned: 0 in 0.232s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-a64ebd72-8861-4378-afe2-681aa910b7bb" released by "_delete_snapshot" :: held 1.403s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" released by "delete_snapshot" :: held 1.424s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=244,cinder:INSERT=86,cinder:UPDATE=292,cinder:DELETE=25 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=216,cinder:UPDATE=318,cinder:INSERT=77,cinder:DELETE=26 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Created reservations ['6587d5ed-1c23-40fb-9a1f-0cff943b041e', '691dd9b1-051b-4bcf-9f3b-7a76a5f530b0', '3829586a-7de5-4274-9414-53a3e7865854', 'cbc564f6-533c-425f-a086-2793467b7061'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:45 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Delete snapshot completed successfully. Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-cfdd5d94-a54c-4945-9320-4b6f08c029f8 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-a64ebd72-8861-4378-afe2-681aa910b7bb-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-1412f0be-cae4-42fa-b76d-be5b4e1c69b0-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-1412f0be-cae4-42fa-b76d-be5b4e1c69b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:45 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "cinder-quobyte-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" acquired by "delete_volume" :: waited 0.025s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539fa6e-d871-416c-9354-3899d5490fe0]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:46 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 Jul 20 16:59:46 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:46 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" returned: 0 in 0.381s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:46 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0 Jul 20 16:59:46 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:46 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" returned: 0 in 0.264s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-quobyte-1412f0be-cae4-42fa-b76d-be5b4e1c69b0" released by "delete_volume" :: held 0.716s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Created reservations ['603022ef-1caa-4af1-afa4-043078cb124d', 'fc54afbc-965c-4e03-94b5-aa4158942be5', '632748cc-6c40-48d2-90e8-3fb8ade46992', 'a4fbf7c0-2d70-4011-9236-0e3a33a776b8'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 16:59:46 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 16:59:46 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 16:59:46 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 16:59:47 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 20 16:59:47 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.285s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 16:59:47 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 16:59:47 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Deleted volume successfully. Jul 20 16:59:47 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-3d968511-8305-4c40-b02b-cfe915e42156 tempest-ProjectMemberTests-1121326326 None] Lock "cinder-1412f0be-cae4-42fa-b76d-be5b4e1c69b0-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 16:59:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 16:59:57 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:INSERT=5,cinder:UPDATE=15,cinder:SELECT=7,cinder:DELETE=1 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Flow 'volume_create_manager' (f14dd3df-38d4-40db-ad5e-fcc8054828e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411d6157-7331-4262-9996-a73d28a16195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411d6157-7331-4262-9996-a73d28a16195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T15:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1797329599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91fec07-42fc-4997-9024-27e91dd6d997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c7bb1d4bf408c892f8b4774c85082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T15:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T15:00:22Z,use_quota=True,user_id='5068fdc4f4f44a3db93cfa03e2ca9e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85186503-1032-4d94-971a-2e23b9725097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85186503-1032-4d94-971a-2e23b9725097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96831ef4-5c7f-42dd-a925-9db8f6dd5a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96831ef4-5c7f-42dd-a925-9db8f6dd5a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b91fec07-42fc-4997-9024-27e91dd6d997', 'volume_name': 'volume-b91fec07-42fc-4997-9024-27e91dd6d997', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64070758-c3c4-4f53-bae5-c599f165d892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64070758-c3c4-4f53-bae5-c599f165d892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389be23b-2499-46da-b234-50a8b49b6225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:21 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Volume b91fec07-42fc-4997-9024-27e91dd6d997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b91fec07-42fc-4997-9024-27e91dd6d997', 'volume_size': 1} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T15:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1797329599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91fec07-42fc-4997-9024-27e91dd6d997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c7bb1d4bf408c892f8b4774c85082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T15:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T15:00:22Z,use_quota=True,user_id='5068fdc4f4f44a3db93cfa03e2ca9e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)}" {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Creating volume b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 17:00:21 devstack cinder-volume[87535]: INFO cinder.volume.drivers.remotefs [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] casted to osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 Jul 20 17:00:21 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 1073741824 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:21 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 1073741824 Jul 20 17:00:21 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:22 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 1073741824" returned: 0 in 0.433s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:22 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:22 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:22 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.245s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'} {{(pid=87535) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389be23b-2499-46da-b234-50a8b49b6225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b91fec07-42fc-4997-9024-27e91dd6d997', 'volume_size': 1}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d7b196-0013-41da-9d89-2d2c26f9a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:22 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Volume volume-b91fec07-42fc-4997-9024-27e91dd6d997 (b91fec07-42fc-4997-9024-27e91dd6d997): created successfully Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d7b196-0013-41da-9d89-2d2c26f9a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Flow 'volume_create_manager' (f14dd3df-38d4-40db-ad5e-fcc8054828e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 17:00:22 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-f8020365-9072-4d03-9eaf-11d408edb551 tempest-SnapshotDependencyTests-1676006882 None] Created volume successfully. Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Creating offline snapshot f9d24739-9d09-4919-992e-b59d17a22d82 of volume b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e78be-f795-4612-9278-208cf1b90305]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:22 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:23 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:23 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:23 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.343s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 1G {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:23 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 1G Jul 20 17:00:23 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:23 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 1G" returned: 0 in 0.370s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91fec07-42fc-4997-9024-27e91dd6d997 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:23 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91fec07-42fc-4997-9024-27e91dd6d997 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 Jul 20 17:00:23 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:23 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b91fec07-42fc-4997-9024-27e91dd6d997 -F qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82" returned: 0 in 0.282s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:23 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 is being set with open permissions: ugo+rw Jul 20 17:00:23 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:23 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 Jul 20 17:00:23 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:24 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82" returned: 0 in 0.237s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:24 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info Jul 20 17:00:24 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:24 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:24 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info is being set with open permissions: ugo+rw Jul 20 17:00:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:24 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info Jul 20 17:00:24 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:24 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.info" returned: 0 in 0.239s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:24 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:24 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-abe14375-c238-45fe-aa77-66295221abe3 tempest-SnapshotDependencyTests-1676006882 None] Create snapshot completed successfully Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87535) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Flow 'volume_create_manager' (d37c4bc7-ecfe-425a-a25f-d6ab1077b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7b9665-b997-4a3a-aae0-6c4ed4220fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7b9665-b997-4a3a-aae0-6c4ed4220fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-20T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68b2a10-f819-4da0-921b-18b5f1286f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3c7bb1d4bf408c892f8b4774c85082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-20T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9d24739-9d09-4919-992e-b59d17a22d82,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-20T15:00:25Z,use_quota=True,user_id='5068fdc4f4f44a3db93cfa03e2ca9e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f64b641e-faec-4c83-bbb3-76e03edd0755),volume_type_id=f64b641e-faec-4c83-bbb3-76e03edd0755)' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa03932-60c7-45ad-a4c6-3426a9f93b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa03932-60c7-45ad-a4c6-3426a9f93b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1909a59f-a2b1-4862-b1b0-71ddc22a4f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1909a59f-a2b1-4862-b1b0-71ddc22a4f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a68b2a10-f819-4da0-921b-18b5f1286f86', 'volume_name': 'volume-a68b2a10-f819-4da0-921b-18b5f1286f86', 'volume_size': 1, 'snapshot_id': 'f9d24739-9d09-4919-992e-b59d17a22d82'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ace0e-9ac6-4f8e-af12-40130a838351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347ace0e-9ac6-4f8e-af12-40130a838351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b671645-3b3e-43b8-a5ea-d623dc8257ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:25 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Volume a68b2a10-f819-4da0-921b-18b5f1286f86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a68b2a10-f819-4da0-921b-18b5f1286f86', 'volume_size': 1, 'snapshot_id': 'f9d24739-9d09-4919-992e-b59d17a22d82'} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-quobyte-f9d24739-9d09-4919-992e-b59d17a22d82-a68b2a10-f819-4da0-921b-18b5f1286f86" by "_create_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-f9d24739-9d09-4919-992e-b59d17a22d82-a68b2a10-f819-4da0-921b-18b5f1286f86" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Creating volume a68b2a10-f819-4da0-921b-18b5f1286f86 from snapshot f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Selected osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2 as target Quobyte volume. {{(pid=87535) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-quobyte-a68b2a10-f819-4da0-921b-18b5f1286f86" by "_copy_volume_from_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-a68b2a10-f819-4da0-921b-18b5f1286f86" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] snapshot: f9d24739-9d09-4919-992e-b59d17a22d82, volume: a68b2a10-f819-4da0-921b-18b5f1286f86, {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9e1dec-fca0-4f57-b7b9-dbee672025af]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:25 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:25 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 Jul 20 17:00:25 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:26 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82" returned: 0 in 0.349s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b91fec07-42fc-4997-9024-27e91dd6d997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Creating direct copy from snapshot {{(pid=87535) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf03c3-3fb6-48a7-b499-40fb482f1b14]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:26 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:26 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:26 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.351s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG cinder.utils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Path /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 not found in is_blk_device check {{(pid=87535) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 20 17:00:26 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:26 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 Jul 20 17:00:26 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:30 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86" returned: 0 in 3.962s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:30 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e259497-02ec-4b80-9a54-185ff221d110]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:30 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:30 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:30 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.535s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:30 devstack cinder-volume[87535]: DEBUG cinder.image.image_utils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Image conversion details: src /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 {{(pid=87535) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 20 17:00:30 devstack cinder-volume[87535]: INFO cinder.image.image_utils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Converted 1024.00 MB image at 258.35 MB/s Jul 20 17:00:30 devstack cinder-volume[87535]: WARNING cinder.volume.drivers.remotefs [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 is being set with open permissions: ugo+rw Jul 20 17:00:30 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:30 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 Jul 20 17:00:30 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:31 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86" returned: 0 in 0.236s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-a68b2a10-f819-4da0-921b-18b5f1286f86" released by "_copy_volume_from_snapshot" :: held 5.517s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-f9d24739-9d09-4919-992e-b59d17a22d82-a68b2a10-f819-4da0-921b-18b5f1286f86" released by "_create_volume_from_snapshot" :: held 5.543s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.556s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b671645-3b3e-43b8-a5ea-d623dc8257ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68b2a10-f819-4da0-921b-18b5f1286f86', 'volume_size': 1, 'snapshot_id': 'f9d24739-9d09-4919-992e-b59d17a22d82'}' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151a1479-efa7-4edf-ad14-22f633a3c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 20 17:00:31 devstack cinder-volume[87535]: INFO cinder.volume.flows.manager.create_volume [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Volume volume-a68b2a10-f819-4da0-921b-18b5f1286f86 (a68b2a10-f819-4da0-921b-18b5f1286f86): created successfully Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151a1479-efa7-4edf-ad14-22f633a3c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87535) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 20 17:00:31 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Flow 'volume_create_manager' (d37c4bc7-ecfe-425a-a25f-d6ab1077b640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87535) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 20 17:00:31 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-07a16586-8172-444c-bc8c-b5b2d876ef5e tempest-SnapshotDependencyTests-1676006882 None] Created volume successfully. Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-f9d24739-9d09-4919-992e-b59d17a22d82-delete_snapshot" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-f9d24739-9d09-4919-992e-b59d17a22d82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-quobyte-b91fec07-42fc-4997-9024-27e91dd6d997" by "delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-b91fec07-42fc-4997-9024-27e91dd6d997" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-quobyte-f9d24739-9d09-4919-992e-b59d17a22d82" by "_delete_snapshot" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-f9d24739-9d09-4919-992e-b59d17a22d82" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Deleting offline snapshot f9d24739-9d09-4919-992e-b59d17a22d82 of volume b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] snapshot_file for this snap is: volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd6c58-64e1-4293-bf7c-ea38b3d71992]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:32 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 Jul 20 17:00:32 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:32 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.remotefs [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b91fec07-42fc-4997-9024-27e91dd6d997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87535) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd9893d-fda0-4e43-8615-ea612ce15811]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:32 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:32 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:32 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:32 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:32 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 Jul 20 17:00:32 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:33 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82" returned: 0 in 0.325s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:33 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82 Jul 20 17:00:33 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:33 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997.f9d24739-9d09-4919-992e-b59d17a22d82" returned: 0 in 0.238s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-f9d24739-9d09-4919-992e-b59d17a22d82" released by "_delete_snapshot" :: held 1.344s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-b91fec07-42fc-4997-9024-27e91dd6d997" released by "delete_snapshot" :: held 1.365s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Created reservations ['5b2548f6-a611-43c5-b553-d29a3e66ff80', '90b574e9-f57d-4f4b-9308-8e319073920d', 'b71dce45-ea7f-41a1-bef3-3abac1179cb1', '43635aae-afe6-4455-9ecf-739ffcf72363'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 17:00:33 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Delete snapshot completed successfully. Jul 20 17:00:33 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-99aa0481-b266-450e-9288-1ffe91fc953e tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-f9d24739-9d09-4919-992e-b59d17a22d82-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-b91fec07-42fc-4997-9024-27e91dd6d997-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-b91fec07-42fc-4997-9024-27e91dd6d997-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-quobyte-b91fec07-42fc-4997-9024-27e91dd6d997" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-b91fec07-42fc-4997-9024-27e91dd6d997" acquired by "delete_volume" :: waited 0.017s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40bb54-bf8e-4bd8-b460-d015e674a90f]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:34 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:34 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:34 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.342s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:34 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997 Jul 20 17:00:34 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:34 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-b91fec07-42fc-4997-9024-27e91dd6d997" returned: 0 in 0.242s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-b91fec07-42fc-4997-9024-27e91dd6d997" released by "delete_volume" :: held 0.637s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Created reservations ['be30a787-d2a3-4d67-b9d3-b38140fc6db9', '97dc00da-0a70-436b-90de-2155630591e2', 'ecbe64d2-8bbd-413e-91a8-9b2a366fb61e', 'f7cb9984-e33c-49e7-990f-03c5bf120d9f'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:34 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:35 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 17:00:35 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:35 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.237s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 17:00:35 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Deleted volume successfully. Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-5156647f-73ec-45be-9624-60844e8cd10b tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-b91fec07-42fc-4997-9024-27e91dd6d997-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-a68b2a10-f819-4da0-921b-18b5f1286f86-delete_volume" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-a68b2a10-f819-4da0-921b-18b5f1286f86-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "cinder-quobyte-a68b2a10-f819-4da0-921b-18b5f1286f86" by "delete_volume" {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-a68b2a10-f819-4da0-921b-18b5f1286f86" acquired by "delete_volume" :: waited 0.013s {{(pid=87535) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa4bd9d-7b27-4547-b9cb-606cd92bf1dc]: (4, 'qcow2') {{(pid=88433) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:35 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 Jul 20 17:00:35 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:35 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86" returned: 0 in 0.348s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:35 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86 Jul 20 17:00:35 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:35 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:35 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285/volume-a68b2a10-f819-4da0-921b-18b5f1286f86" returned: 0 in 0.232s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-quobyte-a68b2a10-f819-4da0-921b-18b5f1286f86" released by "delete_volume" :: held 0.615s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG cinder.quota [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Created reservations ['2b2e80b6-1fec-44aa-b1d0-a2b52643f723', 'ddae3cca-fc2f-4354-94f3-8b0d7652c225', '8de98365-49f3-429b-bbcb-03792d17e182', '0c76a7ca-7fd9-4b30-b2ac-c6242538be3d'] {{(pid=87535) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:36 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 17:00:36 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:36 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.243s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 17:00:36 devstack cinder-volume[87535]: INFO cinder.volume.manager [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Deleted volume successfully. Jul 20 17:00:36 devstack cinder-volume[87535]: DEBUG cinder.coordination [None req-82dbb20c-f08e-410f-9c12-0f3470350936 tempest-SnapshotDependencyTests-1676006882 None] Lock "cinder-a68b2a10-f819-4da0-921b-18b5f1286f86-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87535) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2': None} {{(pid=87535) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-444e6e4a-7694-4775-a74e-1618c02af0b2'] {{(pid=87535) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.lockutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87535) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 20 17:00:39 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285 Jul 20 17:00:39 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 20 17:00:39 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_concurrency.processutils [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ed857da0db44130bb09ffd0fdbfbd285" returned: 0 in 0.235s {{(pid=87535) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG cinder.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Notifying Schedulers of capabilities ... {{(pid=87535) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG oslo_service.periodic_task [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] Running periodic task VolumeManager._thread_info {{(pid=87535) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread count: 28 {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 20 17:00:39 devstack cinder-volume[87535]: DEBUG cinder.volume.manager [None req-1ffa8d8b-c747-4818-91e1-060c65cac444 None None] thread info: [<_MainThread(MainThread, started 125484450259072)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87535) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 20 17:00:46 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:SELECT=19,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 20 17:00:46 devstack cinder-volume[87535]: DEBUG dbcounter [-] [87535] Writing DB stats cinder:UPDATE=24,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87535) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}